2023-09-26 04:00:52,925 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-26 04:00:53,104 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f 2023-09-26 04:00:53,104 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-26 04:00:53,105 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-26 04:00:53,145 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-26 04:00:53,358 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-26 04:00:53,358 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2, deleteOnExit=true 2023-09-26 04:00:53,359 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-26 04:00:53,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/test.cache.data in system properties and HBase conf 2023-09-26 04:00:53,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop.tmp.dir in system properties and HBase conf 2023-09-26 04:00:53,360 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop.log.dir in system properties and HBase conf 2023-09-26 04:00:53,360 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-26 04:00:53,360 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-26 04:00:53,360 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-26 04:00:53,654 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-26 04:00:53,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-26 04:00:53,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-26 04:00:53,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-26 04:00:53,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-26 04:00:53,660 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-26 04:00:53,660 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-26 04:00:53,661 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-26 04:00:53,661 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-26 04:00:53,662 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-26 04:00:53,662 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/nfs.dump.dir in system properties and HBase conf 2023-09-26 04:00:53,663 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir in system properties and HBase conf 2023-09-26 04:00:53,663 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-26 04:00:53,663 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-26 04:00:53,664 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-26 04:00:54,172 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-26 04:00:54,176 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-26 04:00:54,440 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-26 04:00:54,622 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-26 04:00:54,633 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 04:00:54,672 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 04:00:54,703 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir/Jetty_localhost_40755_hdfs____pyyg1x/webapp 2023-09-26 04:00:54,822 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40755 2023-09-26 04:00:54,857 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-26 04:00:54,858 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-26 04:00:55,266 WARN [Listener at localhost/36857] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-26 04:00:55,346 WARN [Listener at localhost/36857] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-26 04:00:55,367 WARN [Listener at localhost/36857] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 04:00:55,374 INFO [Listener at localhost/36857] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 04:00:55,380 INFO [Listener at localhost/36857] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir/Jetty_localhost_35609_datanode____.gkf7uk/webapp 2023-09-26 04:00:55,472 INFO [Listener at localhost/36857] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35609 2023-09-26 04:00:55,899 WARN [Listener at localhost/42003] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-26 04:00:55,915 WARN [Listener at localhost/42003] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-26 04:00:55,918 WARN [Listener at localhost/42003] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 04:00:55,921 INFO [Listener at localhost/42003] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 04:00:55,930 INFO [Listener at localhost/42003] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir/Jetty_localhost_41373_datanode____6epkm1/webapp 2023-09-26 04:00:56,015 INFO [Listener at localhost/42003] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41373 2023-09-26 04:00:56,031 WARN [Listener at localhost/36233] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-26 04:00:56,054 WARN [Listener at localhost/36233] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-26 04:00:56,058 WARN [Listener at localhost/36233] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 04:00:56,060 INFO [Listener at localhost/36233] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 04:00:56,071 INFO [Listener at localhost/36233] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir/Jetty_localhost_33265_datanode____bw8zg8/webapp 2023-09-26 04:00:56,178 INFO [Listener at localhost/36233] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33265 2023-09-26 04:00:56,190 WARN [Listener at localhost/44669] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-26 04:00:56,441 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x293fb2fac9d2839d: Processing first storage report for DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29 from datanode 6f7780c7-0017-460e-aa4e-b45bbebcc480 2023-09-26 04:00:56,442 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x293fb2fac9d2839d: from storage DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29 node DatanodeRegistration(127.0.0.1:45901, datanodeUuid=6f7780c7-0017-460e-aa4e-b45bbebcc480, infoPort=41585, infoSecurePort=0, ipcPort=42003, storageInfo=lv=-57;cid=testClusterID;nsid=1027442935;c=1695700854256), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-26 04:00:56,442 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc018cda2e4cb0e1: Processing first storage report for DS-73776570-fc6a-4984-91d0-eea57a7e5bb7 from datanode ce612958-6f8a-44cb-b69d-f0f69749b9f9 2023-09-26 04:00:56,443 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc018cda2e4cb0e1: from storage DS-73776570-fc6a-4984-91d0-eea57a7e5bb7 node DatanodeRegistration(127.0.0.1:42457, datanodeUuid=ce612958-6f8a-44cb-b69d-f0f69749b9f9, infoPort=46069, infoSecurePort=0, ipcPort=36233, storageInfo=lv=-57;cid=testClusterID;nsid=1027442935;c=1695700854256), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-26 04:00:56,443 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x596d6a2a11980d63: Processing first storage report for DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f from datanode 5c820087-8854-4222-ac01-a6b1d6bff6be 2023-09-26 04:00:56,443 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x596d6a2a11980d63: from storage DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f node DatanodeRegistration(127.0.0.1:40697, datanodeUuid=5c820087-8854-4222-ac01-a6b1d6bff6be, infoPort=43511, infoSecurePort=0, ipcPort=44669, storageInfo=lv=-57;cid=testClusterID;nsid=1027442935;c=1695700854256), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-26 04:00:56,443 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x293fb2fac9d2839d: Processing first storage report for DS-d8db86b6-eb13-49c5-8612-a6f27bf14ce9 from datanode 6f7780c7-0017-460e-aa4e-b45bbebcc480 2023-09-26 04:00:56,443 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x293fb2fac9d2839d: from storage DS-d8db86b6-eb13-49c5-8612-a6f27bf14ce9 node DatanodeRegistration(127.0.0.1:45901, datanodeUuid=6f7780c7-0017-460e-aa4e-b45bbebcc480, infoPort=41585, infoSecurePort=0, ipcPort=42003, storageInfo=lv=-57;cid=testClusterID;nsid=1027442935;c=1695700854256), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-26 04:00:56,443 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc018cda2e4cb0e1: Processing first storage report for DS-8c50b4d5-082a-4ee6-8c30-2fafb22b3dbf from datanode ce612958-6f8a-44cb-b69d-f0f69749b9f9 2023-09-26 04:00:56,444 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc018cda2e4cb0e1: from storage DS-8c50b4d5-082a-4ee6-8c30-2fafb22b3dbf node DatanodeRegistration(127.0.0.1:42457, datanodeUuid=ce612958-6f8a-44cb-b69d-f0f69749b9f9, infoPort=46069, infoSecurePort=0, ipcPort=36233, storageInfo=lv=-57;cid=testClusterID;nsid=1027442935;c=1695700854256), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-26 04:00:56,444 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x596d6a2a11980d63: Processing first storage report for DS-64e6aeeb-a52a-479b-8036-36e2de1aac70 from datanode 5c820087-8854-4222-ac01-a6b1d6bff6be 2023-09-26 04:00:56,444 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x596d6a2a11980d63: from storage DS-64e6aeeb-a52a-479b-8036-36e2de1aac70 node DatanodeRegistration(127.0.0.1:40697, datanodeUuid=5c820087-8854-4222-ac01-a6b1d6bff6be, infoPort=43511, infoSecurePort=0, ipcPort=44669, storageInfo=lv=-57;cid=testClusterID;nsid=1027442935;c=1695700854256), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-26 04:00:56,593 DEBUG [Listener at localhost/44669] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f 2023-09-26 04:00:56,672 INFO [Listener at localhost/44669] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/zookeeper_0, clientPort=55155, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-26 04:00:56,689 INFO [Listener at localhost/44669] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55155 2023-09-26 04:00:56,696 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:56,698 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:57,354 INFO [Listener at localhost/44669] util.FSUtils(471): Created version file at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa with version=8 2023-09-26 04:00:57,354 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/hbase-staging 2023-09-26 04:00:57,678 INFO [Listener at localhost/44669] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-26 04:00:58,066 INFO [Listener at localhost/44669] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-09-26 04:00:58,093 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,093 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,093 INFO [Listener at localhost/44669] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-26 04:00:58,093 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,094 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-26 04:00:58,213 INFO [Listener at localhost/44669] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-26 04:00:58,273 DEBUG [Listener at localhost/44669] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-26 04:00:58,353 INFO [Listener at localhost/44669] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38025 2023-09-26 04:00:58,364 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:58,365 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:58,390 INFO [Listener at localhost/44669] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38025 connecting to ZooKeeper ensemble=127.0.0.1:55155 2023-09-26 04:00:58,439 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:380250x0, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-26 04:00:58,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38025-0x100d1e880710000 connected 2023-09-26 04:00:58,470 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 04:00:58,471 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 04:00:58,482 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-26 04:00:58,488 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38025 2023-09-26 04:00:58,489 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38025 2023-09-26 04:00:58,489 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38025 2023-09-26 04:00:58,490 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38025 2023-09-26 04:00:58,490 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38025 2023-09-26 04:00:58,495 INFO [Listener at localhost/44669] master.HMaster(444): hbase.rootdir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa, hbase.cluster.distributed=false 2023-09-26 04:00:58,548 INFO [Listener at localhost/44669] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-26 04:00:58,549 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,549 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,549 INFO [Listener at localhost/44669] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-26 04:00:58,549 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,549 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-26 04:00:58,553 INFO [Listener at localhost/44669] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-26 04:00:58,556 INFO [Listener at localhost/44669] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43719 2023-09-26 04:00:58,559 INFO [Listener at localhost/44669] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-26 04:00:58,566 INFO [Listener at localhost/44669] mob.MobFileCache(124): MobFileCache disabled 2023-09-26 04:00:58,567 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:58,569 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:58,571 INFO [Listener at localhost/44669] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43719 connecting to ZooKeeper ensemble=127.0.0.1:55155 2023-09-26 04:00:58,575 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:437190x0, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-26 04:00:58,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43719-0x100d1e880710001 connected 2023-09-26 04:00:58,576 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 04:00:58,578 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 04:00:58,579 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-26 04:00:58,579 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43719 2023-09-26 04:00:58,582 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43719 2023-09-26 04:00:58,583 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43719 2023-09-26 04:00:58,583 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43719 2023-09-26 04:00:58,583 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43719 2023-09-26 04:00:58,594 INFO [Listener at localhost/44669] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-26 04:00:58,594 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,594 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,595 INFO [Listener at localhost/44669] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-26 04:00:58,595 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,595 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-26 04:00:58,595 INFO [Listener at localhost/44669] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-26 04:00:58,599 INFO [Listener at localhost/44669] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34445 2023-09-26 04:00:58,599 INFO [Listener at localhost/44669] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-26 04:00:58,600 INFO [Listener at localhost/44669] mob.MobFileCache(124): MobFileCache disabled 2023-09-26 04:00:58,601 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:58,603 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:58,605 INFO [Listener at localhost/44669] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34445 connecting to ZooKeeper ensemble=127.0.0.1:55155 2023-09-26 04:00:58,610 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:344450x0, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-26 04:00:58,611 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): regionserver:344450x0, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 04:00:58,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34445-0x100d1e880710002 connected 2023-09-26 04:00:58,612 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 04:00:58,613 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-26 04:00:58,614 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34445 2023-09-26 04:00:58,614 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34445 2023-09-26 04:00:58,614 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34445 2023-09-26 04:00:58,618 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34445 2023-09-26 04:00:58,618 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34445 2023-09-26 04:00:58,629 INFO [Listener at localhost/44669] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-26 04:00:58,630 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,630 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,630 INFO [Listener at localhost/44669] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-26 04:00:58,630 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-26 04:00:58,630 INFO [Listener at localhost/44669] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-26 04:00:58,630 INFO [Listener at localhost/44669] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-26 04:00:58,632 INFO [Listener at localhost/44669] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44553 2023-09-26 04:00:58,632 INFO [Listener at localhost/44669] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-26 04:00:58,633 INFO [Listener at localhost/44669] mob.MobFileCache(124): MobFileCache disabled 2023-09-26 04:00:58,634 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:58,635 INFO [Listener at localhost/44669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:58,637 INFO [Listener at localhost/44669] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44553 connecting to ZooKeeper ensemble=127.0.0.1:55155 2023-09-26 04:00:58,640 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:445530x0, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-26 04:00:58,641 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): regionserver:445530x0, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 04:00:58,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44553-0x100d1e880710003 connected 2023-09-26 04:00:58,642 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 04:00:58,643 DEBUG [Listener at localhost/44669] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-26 04:00:58,646 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44553 2023-09-26 04:00:58,647 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44553 2023-09-26 04:00:58,650 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44553 2023-09-26 04:00:58,651 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44553 2023-09-26 04:00:58,651 DEBUG [Listener at localhost/44669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44553 2023-09-26 04:00:58,652 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:00:58,660 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-26 04:00:58,662 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:00:58,677 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-26 04:00:58,677 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-26 04:00:58,677 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-26 04:00:58,677 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-26 04:00:58,678 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:00:58,679 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-26 04:00:58,681 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,38025,1695700857519 from backup master directory 2023-09-26 04:00:58,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-26 04:00:58,691 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:00:58,691 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-26 04:00:58,692 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-26 04:00:58,692 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:00:58,695 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-26 04:00:58,696 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-26 04:00:58,787 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/hbase.id with ID: b7c6badc-4a12-4c18-8fb4-da8333f01d6d 2023-09-26 04:00:58,840 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-26 04:00:58,855 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:00:58,900 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0ebc1809 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:00:58,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cd38e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:00:58,955 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-26 04:00:58,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-26 04:00:58,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-26 04:00:58,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-26 04:00:58,974 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-26 04:00:58,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-26 04:00:58,979 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 04:00:59,010 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/data/master/store-tmp 2023-09-26 04:00:59,045 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:00:59,045 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-26 04:00:59,046 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 04:00:59,046 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 04:00:59,046 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-26 04:00:59,046 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 04:00:59,046 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 04:00:59,046 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-26 04:00:59,048 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/WALs/jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:00:59,069 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38025%2C1695700857519, suffix=, logDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/WALs/jenkins-hbase20.apache.org,38025,1695700857519, archiveDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/oldWALs, maxLogs=10 2023-09-26 04:00:59,125 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK] 2023-09-26 04:00:59,125 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK] 2023-09-26 04:00:59,125 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK] 2023-09-26 04:00:59,133 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-26 04:00:59,191 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/WALs/jenkins-hbase20.apache.org,38025,1695700857519/jenkins-hbase20.apache.org%2C38025%2C1695700857519.1695700859079 2023-09-26 04:00:59,192 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK], DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK], DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK]] 2023-09-26 04:00:59,192 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-26 04:00:59,193 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:00:59,195 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-26 04:00:59,196 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-26 04:00:59,255 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-26 04:00:59,264 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-26 04:00:59,299 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-26 04:00:59,311 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:00:59,317 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-26 04:00:59,318 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-26 04:00:59,332 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-26 04:00:59,336 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:00:59,337 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74999332, jitterRate=0.11757713556289673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:00:59,337 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-26 04:00:59,339 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-26 04:00:59,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-26 04:00:59,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-26 04:00:59,361 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-26 04:00:59,363 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-26 04:00:59,394 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 31 msec 2023-09-26 04:00:59,395 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-26 04:00:59,420 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-26 04:00:59,425 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-26 04:00:59,446 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-26 04:00:59,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-26 04:00:59,451 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-26 04:00:59,454 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.SimpleRegionNormalizer(156): Updated configuration for key 'hbase.normalizer.merge.merge_request_max_number_of_regions' from 100 to 50 2023-09-26 04:00:59,456 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-26 04:00:59,460 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-26 04:00:59,462 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:00:59,464 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-26 04:00:59,464 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-26 04:00:59,478 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-26 04:00:59,482 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-26 04:00:59,482 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-26 04:00:59,482 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-26 04:00:59,482 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-26 04:00:59,482 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:00:59,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,38025,1695700857519, sessionid=0x100d1e880710000, setting cluster-up flag (Was=false) 2023-09-26 04:00:59,501 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:00:59,505 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-26 04:00:59,506 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:00:59,516 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:00:59,519 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-26 04:00:59,521 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:00:59,524 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp 2023-09-26 04:00:59,555 INFO [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(951): ClusterId : b7c6badc-4a12-4c18-8fb4-da8333f01d6d 2023-09-26 04:00:59,555 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(951): ClusterId : b7c6badc-4a12-4c18-8fb4-da8333f01d6d 2023-09-26 04:00:59,556 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(951): ClusterId : b7c6badc-4a12-4c18-8fb4-da8333f01d6d 2023-09-26 04:00:59,563 DEBUG [RS:0;jenkins-hbase20:43719] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-26 04:00:59,563 DEBUG [RS:2;jenkins-hbase20:44553] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-26 04:00:59,563 DEBUG [RS:1;jenkins-hbase20:34445] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-26 04:00:59,568 DEBUG [RS:1;jenkins-hbase20:34445] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-26 04:00:59,568 DEBUG [RS:2;jenkins-hbase20:44553] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-26 04:00:59,568 DEBUG [RS:0;jenkins-hbase20:43719] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-26 04:00:59,568 DEBUG [RS:2;jenkins-hbase20:44553] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-26 04:00:59,568 DEBUG [RS:1;jenkins-hbase20:34445] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-26 04:00:59,568 DEBUG [RS:0;jenkins-hbase20:43719] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-26 04:00:59,572 DEBUG [RS:1;jenkins-hbase20:34445] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-26 04:00:59,572 DEBUG [RS:0;jenkins-hbase20:43719] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-26 04:00:59,573 DEBUG [RS:2;jenkins-hbase20:44553] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-26 04:00:59,576 DEBUG [RS:2;jenkins-hbase20:44553] zookeeper.ReadOnlyZKClient(139): Connect 0x4536983d to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:00:59,576 DEBUG [RS:1;jenkins-hbase20:34445] zookeeper.ReadOnlyZKClient(139): Connect 0x77c8214c to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:00:59,576 DEBUG [RS:0;jenkins-hbase20:43719] zookeeper.ReadOnlyZKClient(139): Connect 0x0d193553 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:00:59,588 DEBUG [RS:2;jenkins-hbase20:44553] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bf17eeb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:00:59,590 DEBUG [RS:2;jenkins-hbase20:44553] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fcef34d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-26 04:00:59,594 DEBUG [RS:1;jenkins-hbase20:34445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@790fc1c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:00:59,594 DEBUG [RS:1;jenkins-hbase20:34445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d304a3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-26 04:00:59,595 DEBUG [RS:0;jenkins-hbase20:43719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3deca80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:00:59,596 DEBUG [RS:0;jenkins-hbase20:43719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e15e23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-26 04:00:59,617 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:34445 2023-09-26 04:00:59,617 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:44553 2023-09-26 04:00:59,622 DEBUG [RS:0;jenkins-hbase20:43719] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:43719 2023-09-26 04:00:59,626 INFO [RS:1;jenkins-hbase20:34445] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-26 04:00:59,627 INFO [RS:1;jenkins-hbase20:34445] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-26 04:00:59,626 INFO [RS:2;jenkins-hbase20:44553] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-26 04:00:59,626 INFO [RS:0;jenkins-hbase20:43719] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-26 04:00:59,627 INFO [RS:0;jenkins-hbase20:43719] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-26 04:00:59,627 INFO [RS:2;jenkins-hbase20:44553] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-26 04:00:59,631 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-26 04:00:59,632 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-26 04:00:59,632 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-26 04:00:59,632 DEBUG [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-26 04:00:59,634 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:00:59,634 INFO [RS:0;jenkins-hbase20:43719] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:00:59,634 INFO [RS:1;jenkins-hbase20:34445] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:00:59,634 INFO [RS:2;jenkins-hbase20:44553] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:00:59,635 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1022): About to register with Master. 2023-09-26 04:00:59,635 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1022): About to register with Master. 2023-09-26 04:00:59,635 DEBUG [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1022): About to register with Master. 2023-09-26 04:00:59,635 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-26 04:00:59,637 INFO [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38025,1695700857519 with isa=jenkins-hbase20.apache.org/148.251.75.209:43719, startcode=1695700858548 2023-09-26 04:00:59,637 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38025,1695700857519 with isa=jenkins-hbase20.apache.org/148.251.75.209:34445, startcode=1695700858593 2023-09-26 04:00:59,637 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38025,1695700857519 with isa=jenkins-hbase20.apache.org/148.251.75.209:44553, startcode=1695700858629 2023-09-26 04:00:59,657 DEBUG [RS:2;jenkins-hbase20:44553] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-26 04:00:59,657 DEBUG [RS:1;jenkins-hbase20:34445] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-26 04:00:59,657 DEBUG [RS:0;jenkins-hbase20:43719] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-26 04:00:59,722 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56661, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-26 04:00:59,722 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54823, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-26 04:00:59,722 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47127, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-26 04:00:59,731 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38025] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-26 04:00:59,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-26 04:00:59,741 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38025] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-26 04:00:59,742 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38025] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-26 04:00:59,744 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-26 04:00:59,744 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-26 04:00:59,744 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-26 04:00:59,744 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-26 04:00:59,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-09-26 04:00:59,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-26 04:00:59,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,748 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695700889748 2023-09-26 04:00:59,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-26 04:00:59,753 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-26 04:00:59,754 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-26 04:00:59,758 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-26 04:00:59,761 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(2830): Master is not running yet 2023-09-26 04:00:59,761 WARN [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-26 04:00:59,761 DEBUG [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(2830): Master is not running yet 2023-09-26 04:00:59,761 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(2830): Master is not running yet 2023-09-26 04:00:59,762 WARN [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-26 04:00:59,762 WARN [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-26 04:00:59,762 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-26 04:00:59,767 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-26 04:00:59,768 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-26 04:00:59,768 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-26 04:00:59,768 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-26 04:00:59,770 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,772 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-26 04:00:59,775 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-26 04:00:59,775 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-26 04:00:59,778 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-26 04:00:59,779 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-26 04:00:59,781 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1695700859781,5,FailOnTimeoutGroup] 2023-09-26 04:00:59,781 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1695700859781,5,FailOnTimeoutGroup] 2023-09-26 04:00:59,781 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,782 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-26 04:00:59,786 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,788 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,797 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-26 04:00:59,798 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-26 04:00:59,798 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:00:59,821 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:00:59,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-26 04:00:59,826 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/info 2023-09-26 04:00:59,827 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-26 04:00:59,828 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:00:59,828 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-26 04:00:59,830 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/rep_barrier 2023-09-26 04:00:59,831 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-26 04:00:59,832 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:00:59,832 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-26 04:00:59,834 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/table 2023-09-26 04:00:59,835 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-26 04:00:59,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:00:59,837 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740 2023-09-26 04:00:59,838 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740 2023-09-26 04:00:59,842 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-26 04:00:59,844 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-26 04:00:59,849 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:00:59,850 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66401782, jitterRate=-0.010536342859268188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-26 04:00:59,850 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-26 04:00:59,850 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-26 04:00:59,850 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-26 04:00:59,850 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-26 04:00:59,850 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-26 04:00:59,850 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-26 04:00:59,852 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-26 04:00:59,852 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-26 04:00:59,857 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-26 04:00:59,857 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-26 04:00:59,862 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38025,1695700857519 with isa=jenkins-hbase20.apache.org/148.251.75.209:34445, startcode=1695700858593 2023-09-26 04:00:59,863 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38025,1695700857519 with isa=jenkins-hbase20.apache.org/148.251.75.209:44553, startcode=1695700858629 2023-09-26 04:00:59,863 INFO [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38025,1695700857519 with isa=jenkins-hbase20.apache.org/148.251.75.209:43719, startcode=1695700858548 2023-09-26 04:00:59,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-26 04:00:59,870 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38025] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:00:59,877 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38025] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:00:59,878 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:00:59,878 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38025] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:00:59,878 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36857 2023-09-26 04:00:59,878 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-26 04:00:59,879 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:00:59,879 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36857 2023-09-26 04:00:59,879 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-26 04:00:59,880 DEBUG [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:00:59,881 DEBUG [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36857 2023-09-26 04:00:59,881 DEBUG [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-26 04:00:59,886 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 04:00:59,888 DEBUG [RS:1;jenkins-hbase20:34445] zookeeper.ZKUtil(162): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:00:59,888 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-26 04:00:59,888 WARN [RS:1;jenkins-hbase20:34445] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-26 04:00:59,889 INFO [RS:1;jenkins-hbase20:34445] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 04:00:59,889 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:00:59,889 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,43719,1695700858548] 2023-09-26 04:00:59,889 DEBUG [RS:0;jenkins-hbase20:43719] zookeeper.ZKUtil(162): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:00:59,889 DEBUG [RS:2;jenkins-hbase20:44553] zookeeper.ZKUtil(162): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:00:59,890 WARN [RS:0;jenkins-hbase20:43719] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-26 04:00:59,889 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34445,1695700858593] 2023-09-26 04:00:59,890 WARN [RS:2;jenkins-hbase20:44553] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-26 04:00:59,890 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44553,1695700858629] 2023-09-26 04:00:59,891 INFO [RS:2;jenkins-hbase20:44553] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 04:00:59,890 INFO [RS:0;jenkins-hbase20:43719] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 04:00:59,891 DEBUG [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:00:59,891 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:00:59,897 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-26 04:00:59,907 DEBUG [RS:0;jenkins-hbase20:43719] zookeeper.ZKUtil(162): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:00:59,907 DEBUG [RS:2;jenkins-hbase20:44553] zookeeper.ZKUtil(162): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:00:59,907 DEBUG [RS:1;jenkins-hbase20:34445] zookeeper.ZKUtil(162): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:00:59,907 DEBUG [RS:0;jenkins-hbase20:43719] zookeeper.ZKUtil(162): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:00:59,907 DEBUG [RS:2;jenkins-hbase20:44553] zookeeper.ZKUtil(162): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:00:59,908 DEBUG [RS:1;jenkins-hbase20:34445] zookeeper.ZKUtil(162): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:00:59,908 DEBUG [RS:0;jenkins-hbase20:43719] zookeeper.ZKUtil(162): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:00:59,908 DEBUG [RS:2;jenkins-hbase20:44553] zookeeper.ZKUtil(162): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:00:59,908 DEBUG [RS:1;jenkins-hbase20:34445] zookeeper.ZKUtil(162): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:00:59,918 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-26 04:00:59,919 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-26 04:00:59,918 DEBUG [RS:0;jenkins-hbase20:43719] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-26 04:00:59,928 INFO [RS:2;jenkins-hbase20:44553] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-26 04:00:59,928 INFO [RS:1;jenkins-hbase20:34445] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-26 04:00:59,928 INFO [RS:0;jenkins-hbase20:43719] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-26 04:00:59,952 INFO [RS:0;jenkins-hbase20:43719] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-26 04:00:59,952 INFO [RS:2;jenkins-hbase20:44553] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-26 04:00:59,952 INFO [RS:1;jenkins-hbase20:34445] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-26 04:00:59,956 INFO [RS:2;jenkins-hbase20:44553] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-26 04:00:59,956 INFO [RS:0;jenkins-hbase20:43719] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-26 04:00:59,956 INFO [RS:1;jenkins-hbase20:34445] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-26 04:00:59,957 INFO [RS:0;jenkins-hbase20:43719] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,957 INFO [RS:2;jenkins-hbase20:44553] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,957 INFO [RS:1;jenkins-hbase20:34445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,958 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-26 04:00:59,958 INFO [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-26 04:00:59,958 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-26 04:00:59,965 INFO [RS:1;jenkins-hbase20:34445] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,965 INFO [RS:2;jenkins-hbase20:44553] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,965 INFO [RS:0;jenkins-hbase20:43719] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,966 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,966 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,966 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,966 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,966 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,966 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,966 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,966 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,966 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,966 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-26 04:00:59,966 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-26 04:00:59,967 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-26 04:00:59,967 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:2;jenkins-hbase20:44553] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:0;jenkins-hbase20:43719] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,967 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,968 DEBUG [RS:1;jenkins-hbase20:34445] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-26 04:00:59,970 INFO [RS:1;jenkins-hbase20:34445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,970 INFO [RS:2;jenkins-hbase20:44553] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,970 INFO [RS:1;jenkins-hbase20:34445] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,970 INFO [RS:2;jenkins-hbase20:44553] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,970 INFO [RS:1;jenkins-hbase20:34445] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,971 INFO [RS:2;jenkins-hbase20:44553] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,975 INFO [RS:0;jenkins-hbase20:43719] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,975 INFO [RS:0;jenkins-hbase20:43719] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,975 INFO [RS:0;jenkins-hbase20:43719] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,989 INFO [RS:0;jenkins-hbase20:43719] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-26 04:00:59,989 INFO [RS:1;jenkins-hbase20:34445] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-26 04:00:59,990 INFO [RS:2;jenkins-hbase20:44553] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-26 04:00:59,993 INFO [RS:1;jenkins-hbase20:34445] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34445,1695700858593-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,993 INFO [RS:2;jenkins-hbase20:44553] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44553,1695700858629-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 04:00:59,993 INFO [RS:0;jenkins-hbase20:43719] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43719,1695700858548-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 04:01:00,014 INFO [RS:0;jenkins-hbase20:43719] regionserver.Replication(203): jenkins-hbase20.apache.org,43719,1695700858548 started 2023-09-26 04:01:00,014 INFO [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,43719,1695700858548, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:43719, sessionid=0x100d1e880710001 2023-09-26 04:01:00,015 DEBUG [RS:0;jenkins-hbase20:43719] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-26 04:01:00,015 DEBUG [RS:0;jenkins-hbase20:43719] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:00,015 DEBUG [RS:0;jenkins-hbase20:43719] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43719,1695700858548' 2023-09-26 04:01:00,015 DEBUG [RS:0;jenkins-hbase20:43719] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-26 04:01:00,016 DEBUG [RS:0;jenkins-hbase20:43719] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-26 04:01:00,016 DEBUG [RS:0;jenkins-hbase20:43719] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-26 04:01:00,016 DEBUG [RS:0;jenkins-hbase20:43719] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-26 04:01:00,016 DEBUG [RS:0;jenkins-hbase20:43719] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:00,016 DEBUG [RS:0;jenkins-hbase20:43719] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43719,1695700858548' 2023-09-26 04:01:00,016 DEBUG [RS:0;jenkins-hbase20:43719] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:00,017 DEBUG [RS:0;jenkins-hbase20:43719] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:00,017 DEBUG [RS:0;jenkins-hbase20:43719] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-26 04:01:00,017 INFO [RS:0;jenkins-hbase20:43719] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-26 04:01:00,017 INFO [RS:0;jenkins-hbase20:43719] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-26 04:01:00,018 INFO [RS:1;jenkins-hbase20:34445] regionserver.Replication(203): jenkins-hbase20.apache.org,34445,1695700858593 started 2023-09-26 04:01:00,018 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,34445,1695700858593, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34445, sessionid=0x100d1e880710002 2023-09-26 04:01:00,018 INFO [RS:2;jenkins-hbase20:44553] regionserver.Replication(203): jenkins-hbase20.apache.org,44553,1695700858629 started 2023-09-26 04:01:00,018 DEBUG [RS:1;jenkins-hbase20:34445] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-26 04:01:00,018 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,44553,1695700858629, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44553, sessionid=0x100d1e880710003 2023-09-26 04:01:00,018 DEBUG [RS:1;jenkins-hbase20:34445] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:00,019 DEBUG [RS:2;jenkins-hbase20:44553] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-26 04:01:00,019 DEBUG [RS:1;jenkins-hbase20:34445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34445,1695700858593' 2023-09-26 04:01:00,019 DEBUG [RS:2;jenkins-hbase20:44553] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:00,019 DEBUG [RS:1;jenkins-hbase20:34445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-26 04:01:00,019 DEBUG [RS:2;jenkins-hbase20:44553] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44553,1695700858629' 2023-09-26 04:01:00,020 DEBUG [RS:2;jenkins-hbase20:44553] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-26 04:01:00,020 DEBUG [RS:2;jenkins-hbase20:44553] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-26 04:01:00,020 DEBUG [RS:1;jenkins-hbase20:34445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-26 04:01:00,021 DEBUG [RS:2;jenkins-hbase20:44553] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-26 04:01:00,021 DEBUG [RS:1;jenkins-hbase20:34445] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-26 04:01:00,021 DEBUG [RS:2;jenkins-hbase20:44553] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-26 04:01:00,021 DEBUG [RS:1;jenkins-hbase20:34445] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-26 04:01:00,021 DEBUG [RS:2;jenkins-hbase20:44553] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:00,021 DEBUG [RS:1;jenkins-hbase20:34445] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:00,021 DEBUG [RS:2;jenkins-hbase20:44553] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44553,1695700858629' 2023-09-26 04:01:00,021 DEBUG [RS:1;jenkins-hbase20:34445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34445,1695700858593' 2023-09-26 04:01:00,021 DEBUG [RS:1;jenkins-hbase20:34445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:00,021 DEBUG [RS:2;jenkins-hbase20:44553] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:00,022 DEBUG [RS:2;jenkins-hbase20:44553] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:00,022 DEBUG [RS:1;jenkins-hbase20:34445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:00,022 DEBUG [RS:2;jenkins-hbase20:44553] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-26 04:01:00,022 DEBUG [RS:1;jenkins-hbase20:34445] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-26 04:01:00,022 INFO [RS:2;jenkins-hbase20:44553] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-26 04:01:00,024 INFO [RS:1;jenkins-hbase20:34445] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-26 04:01:00,024 INFO [RS:1;jenkins-hbase20:34445] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-26 04:01:00,024 INFO [RS:2;jenkins-hbase20:44553] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-26 04:01:00,050 DEBUG [jenkins-hbase20:38025] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-26 04:01:00,054 DEBUG [jenkins-hbase20:38025] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:01:00,059 DEBUG [jenkins-hbase20:38025] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:01:00,059 DEBUG [jenkins-hbase20:38025] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:01:00,059 DEBUG [jenkins-hbase20:38025] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:01:00,059 DEBUG [jenkins-hbase20:38025] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:01:00,061 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44553,1695700858629, state=OPENING 2023-09-26 04:01:00,067 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-26 04:01:00,068 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:01:00,069 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-26 04:01:00,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44553,1695700858629}] 2023-09-26 04:01:00,127 INFO [RS:2;jenkins-hbase20:44553] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44553%2C1695700858629, suffix=, logDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,44553,1695700858629, archiveDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/oldWALs, maxLogs=32 2023-09-26 04:01:00,127 INFO [RS:0;jenkins-hbase20:43719] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43719%2C1695700858548, suffix=, logDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,43719,1695700858548, archiveDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/oldWALs, maxLogs=32 2023-09-26 04:01:00,127 INFO [RS:1;jenkins-hbase20:34445] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34445%2C1695700858593, suffix=, logDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,34445,1695700858593, archiveDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/oldWALs, maxLogs=32 2023-09-26 04:01:00,159 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK] 2023-09-26 04:01:00,159 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK] 2023-09-26 04:01:00,159 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK] 2023-09-26 04:01:00,160 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK] 2023-09-26 04:01:00,160 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK] 2023-09-26 04:01:00,160 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK] 2023-09-26 04:01:00,161 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK] 2023-09-26 04:01:00,163 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK] 2023-09-26 04:01:00,163 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK] 2023-09-26 04:01:00,185 INFO [RS:2;jenkins-hbase20:44553] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,44553,1695700858629/jenkins-hbase20.apache.org%2C44553%2C1695700858629.1695700860130 2023-09-26 04:01:00,185 INFO [RS:1;jenkins-hbase20:34445] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,34445,1695700858593/jenkins-hbase20.apache.org%2C34445%2C1695700858593.1695700860130 2023-09-26 04:01:00,185 INFO [RS:0;jenkins-hbase20:43719] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,43719,1695700858548/jenkins-hbase20.apache.org%2C43719%2C1695700858548.1695700860130 2023-09-26 04:01:00,186 DEBUG [RS:2;jenkins-hbase20:44553] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK], DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK], DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK]] 2023-09-26 04:01:00,186 DEBUG [RS:0;jenkins-hbase20:43719] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK], DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK], DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK]] 2023-09-26 04:01:00,187 DEBUG [RS:1;jenkins-hbase20:34445] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK], DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK], DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK]] 2023-09-26 04:01:00,254 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:00,255 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 04:01:00,258 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 04:01:00,270 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-26 04:01:00,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-26 04:01:00,275 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44553%2C1695700858629.meta, suffix=.meta, logDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,44553,1695700858629, archiveDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/oldWALs, maxLogs=32 2023-09-26 04:01:00,293 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK] 2023-09-26 04:01:00,294 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK] 2023-09-26 04:01:00,294 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK] 2023-09-26 04:01:00,301 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,44553,1695700858629/jenkins-hbase20.apache.org%2C44553%2C1695700858629.meta.1695700860276.meta 2023-09-26 04:01:00,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42457,DS-73776570-fc6a-4984-91d0-eea57a7e5bb7,DISK], DatanodeInfoWithStorage[127.0.0.1:45901,DS-e1b80462-3c8a-4b18-8fcb-44ff4be77c29,DISK], DatanodeInfoWithStorage[127.0.0.1:40697,DS-d76425e8-0d8d-4a99-b8a4-002213b27a3f,DISK]] 2023-09-26 04:01:00,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-26 04:01:00,303 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-26 04:01:00,305 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:01:00,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-26 04:01:00,309 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-26 04:01:00,311 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-26 04:01:00,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-26 04:01:00,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:00,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-26 04:01:00,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-26 04:01:00,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-26 04:01:00,327 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/info 2023-09-26 04:01:00,327 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/info 2023-09-26 04:01:00,328 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-26 04:01:00,329 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:00,329 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-26 04:01:00,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/rep_barrier 2023-09-26 04:01:00,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/rep_barrier 2023-09-26 04:01:00,332 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-26 04:01:00,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:00,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-26 04:01:00,335 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/table 2023-09-26 04:01:00,335 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/table 2023-09-26 04:01:00,336 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-26 04:01:00,337 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:00,339 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740 2023-09-26 04:01:00,343 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740 2023-09-26 04:01:00,346 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-26 04:01:00,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-26 04:01:00,349 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61914768, jitterRate=-0.07739806175231934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-26 04:01:00,351 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-26 04:01:00,361 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695700860247 2023-09-26 04:01:00,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-26 04:01:00,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-26 04:01:00,386 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44553,1695700858629, state=OPEN 2023-09-26 04:01:00,390 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-26 04:01:00,390 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-26 04:01:00,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-26 04:01:00,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44553,1695700858629 in 317 msec 2023-09-26 04:01:00,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-26 04:01:00,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 534 msec 2023-09-26 04:01:00,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 771 msec 2023-09-26 04:01:00,421 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695700860421, completionTime=-1 2023-09-26 04:01:00,421 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-26 04:01:00,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-26 04:01:00,489 DEBUG [hconnection-0x6d03649-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:00,493 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:00,513 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-26 04:01:00,514 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695700920514 2023-09-26 04:01:00,514 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695700980514 2023-09-26 04:01:00,514 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 93 msec 2023-09-26 04:01:00,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38025,1695700857519-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-26 04:01:00,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38025,1695700857519-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-26 04:01:00,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38025,1695700857519-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-26 04:01:00,549 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:38025, period=300000, unit=MILLISECONDS is enabled. 2023-09-26 04:01:00,549 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-26 04:01:00,579 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-26 04:01:00,587 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-26 04:01:00,588 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-26 04:01:00,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-26 04:01:00,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 04:01:00,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 04:01:00,631 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:01:00,633 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2 empty. 2023-09-26 04:01:00,634 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:01:00,634 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-26 04:01:00,671 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-26 04:01:00,672 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e87da35e52c00eb894f507f4557e0ab2, NAME => 'hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:01:00,690 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:00,690 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e87da35e52c00eb894f507f4557e0ab2, disabling compactions & flushes 2023-09-26 04:01:00,690 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:01:00,690 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:01:00,691 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. after waiting 0 ms 2023-09-26 04:01:00,691 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:01:00,691 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:01:00,691 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e87da35e52c00eb894f507f4557e0ab2: 2023-09-26 04:01:00,695 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 04:01:00,707 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695700860698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700860698"}]},"ts":"1695700860698"} 2023-09-26 04:01:00,735 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-26 04:01:00,737 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 04:01:00,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700860737"}]},"ts":"1695700860737"} 2023-09-26 04:01:00,746 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-26 04:01:00,749 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:01:00,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:01:00,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:01:00,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:01:00,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:01:00,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e87da35e52c00eb894f507f4557e0ab2, ASSIGN}] 2023-09-26 04:01:00,757 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e87da35e52c00eb894f507f4557e0ab2, ASSIGN 2023-09-26 04:01:00,759 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e87da35e52c00eb894f507f4557e0ab2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34445,1695700858593; forceNewPlan=false, retain=false 2023-09-26 04:01:00,911 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-26 04:01:00,912 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e87da35e52c00eb894f507f4557e0ab2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:00,912 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695700860912"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700860912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700860912"}]},"ts":"1695700860912"} 2023-09-26 04:01:00,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e87da35e52c00eb894f507f4557e0ab2, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:01:01,071 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:01,071 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 04:01:01,075 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 04:01:01,080 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:01:01,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e87da35e52c00eb894f507f4557e0ab2, NAME => 'hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2.', STARTKEY => '', ENDKEY => ''} 2023-09-26 04:01:01,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. service=AccessControlService 2023-09-26 04:01:01,082 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:01:01,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:01:01,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:01,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:01:01,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:01:01,086 INFO [StoreOpener-e87da35e52c00eb894f507f4557e0ab2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:01:01,088 DEBUG [StoreOpener-e87da35e52c00eb894f507f4557e0ab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2/info 2023-09-26 04:01:01,089 DEBUG [StoreOpener-e87da35e52c00eb894f507f4557e0ab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2/info 2023-09-26 04:01:01,089 INFO [StoreOpener-e87da35e52c00eb894f507f4557e0ab2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e87da35e52c00eb894f507f4557e0ab2 columnFamilyName info 2023-09-26 04:01:01,090 INFO [StoreOpener-e87da35e52c00eb894f507f4557e0ab2-1] regionserver.HStore(310): Store=e87da35e52c00eb894f507f4557e0ab2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:01,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:01:01,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:01:01,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:01:01,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:01:01,102 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e87da35e52c00eb894f507f4557e0ab2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71346896, jitterRate=0.06315159797668457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:01:01,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e87da35e52c00eb894f507f4557e0ab2: 2023-09-26 04:01:01,104 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2., pid=6, masterSystemTime=1695700861071 2023-09-26 04:01:01,108 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:01:01,109 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:01:01,110 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e87da35e52c00eb894f507f4557e0ab2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:01,111 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695700861110"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700861110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700861110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700861110"}]},"ts":"1695700861110"} 2023-09-26 04:01:01,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-26 04:01:01,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e87da35e52c00eb894f507f4557e0ab2, server=jenkins-hbase20.apache.org,34445,1695700858593 in 197 msec 2023-09-26 04:01:01,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-26 04:01:01,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e87da35e52c00eb894f507f4557e0ab2, ASSIGN in 365 msec 2023-09-26 04:01:01,125 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 04:01:01,125 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700861125"}]},"ts":"1695700861125"} 2023-09-26 04:01:01,128 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-26 04:01:01,130 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 04:01:01,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 542 msec 2023-09-26 04:01:01,201 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-26 04:01:01,202 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-26 04:01:01,202 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:01:01,222 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:01,226 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:01,242 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-26 04:01:01,260 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-26 04:01:01,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-09-26 04:01:01,276 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-26 04:01:01,288 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-26 04:01:01,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-26 04:01:01,302 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-26 04:01:01,304 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-26 04:01:01,304 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.612sec 2023-09-26 04:01:01,307 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-26 04:01:01,309 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-26 04:01:01,309 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-26 04:01:01,311 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38025,1695700857519-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-26 04:01:01,312 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38025,1695700857519-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-26 04:01:01,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-26 04:01:01,336 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-26 04:01:01,338 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 04:01:01,340 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 04:01:01,342 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-26 04:01:01,343 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:01:01,344 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f empty. 2023-09-26 04:01:01,346 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:01:01,347 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-26 04:01:01,350 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-26 04:01:01,371 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-26 04:01:01,373 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => dbeb6b48238ce29593f05f126a81ef9f, NAME => 'hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:01:01,377 DEBUG [Listener at localhost/44669] zookeeper.ReadOnlyZKClient(139): Connect 0x4423e4e4 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:01,389 DEBUG [Listener at localhost/44669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bd4066d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:01,405 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:01,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing dbeb6b48238ce29593f05f126a81ef9f, disabling compactions & flushes 2023-09-26 04:01:01,406 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:01:01,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:01:01,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. after waiting 0 ms 2023-09-26 04:01:01,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:01:01,406 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:01:01,407 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for dbeb6b48238ce29593f05f126a81ef9f: 2023-09-26 04:01:01,411 DEBUG [hconnection-0x505f8408-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:01,413 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 04:01:01,415 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695700861414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700861414"}]},"ts":"1695700861414"} 2023-09-26 04:01:01,418 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-26 04:01:01,421 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 04:01:01,421 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700861421"}]},"ts":"1695700861421"} 2023-09-26 04:01:01,425 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:01,425 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-26 04:01:01,428 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:01:01,428 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:01:01,428 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-26 04:01:01,429 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/test.cache.data in system properties and HBase conf 2023-09-26 04:01:01,429 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop.tmp.dir in system properties and HBase conf 2023-09-26 04:01:01,429 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop.log.dir in system properties and HBase conf 2023-09-26 04:01:01,429 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-26 04:01:01,429 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-26 04:01:01,429 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-26 04:01:01,429 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-26 04:01:01,429 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-26 04:01:01,429 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:01:01,429 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-26 04:01:01,429 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-26 04:01:01,430 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-26 04:01:01,430 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-26 04:01:01,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=dbeb6b48238ce29593f05f126a81ef9f, ASSIGN}] 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/nfs.dump.dir in system properties and HBase conf 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir in system properties and HBase conf 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-26 04:01:01,430 INFO [Listener at localhost/44669] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-26 04:01:01,433 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=dbeb6b48238ce29593f05f126a81ef9f, ASSIGN 2023-09-26 04:01:01,435 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=dbeb6b48238ce29593f05f126a81ef9f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34445,1695700858593; forceNewPlan=false, retain=false 2023-09-26 04:01:01,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-26 04:01:01,585 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-26 04:01:01,586 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dbeb6b48238ce29593f05f126a81ef9f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:01,587 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695700861586"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700861586"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700861586"}]},"ts":"1695700861586"} 2023-09-26 04:01:01,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure dbeb6b48238ce29593f05f126a81ef9f, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:01:01,654 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-26 04:01:01,752 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:01:01,753 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbeb6b48238ce29593f05f126a81ef9f, NAME => 'hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f.', STARTKEY => '', ENDKEY => ''} 2023-09-26 04:01:01,753 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. service=AccessControlService 2023-09-26 04:01:01,753 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:01:01,753 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:01:01,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:01,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:01:01,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:01:01,756 INFO [StoreOpener-dbeb6b48238ce29593f05f126a81ef9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:01:01,759 DEBUG [StoreOpener-dbeb6b48238ce29593f05f126a81ef9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f/l 2023-09-26 04:01:01,760 DEBUG [StoreOpener-dbeb6b48238ce29593f05f126a81ef9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f/l 2023-09-26 04:01:01,760 INFO [StoreOpener-dbeb6b48238ce29593f05f126a81ef9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbeb6b48238ce29593f05f126a81ef9f columnFamilyName l 2023-09-26 04:01:01,761 INFO [StoreOpener-dbeb6b48238ce29593f05f126a81ef9f-1] regionserver.HStore(310): Store=dbeb6b48238ce29593f05f126a81ef9f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:01,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:01:01,766 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:01:01,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:01:01,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:01:01,780 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened dbeb6b48238ce29593f05f126a81ef9f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68794792, jitterRate=0.02512228488922119}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:01:01,781 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for dbeb6b48238ce29593f05f126a81ef9f: 2023-09-26 04:01:01,785 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f., pid=11, masterSystemTime=1695700861747 2023-09-26 04:01:01,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:01:01,789 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:01:01,790 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dbeb6b48238ce29593f05f126a81ef9f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:01,790 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695700861790"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700861790"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700861790"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700861790"}]},"ts":"1695700861790"} 2023-09-26 04:01:01,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-26 04:01:01,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure dbeb6b48238ce29593f05f126a81ef9f, server=jenkins-hbase20.apache.org,34445,1695700858593 in 203 msec 2023-09-26 04:01:01,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-26 04:01:01,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=dbeb6b48238ce29593f05f126a81ef9f, ASSIGN in 370 msec 2023-09-26 04:01:01,811 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 04:01:01,811 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700861811"}]},"ts":"1695700861811"} 2023-09-26 04:01:01,815 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-26 04:01:01,820 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 04:01:01,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 485 msec 2023-09-26 04:01:01,954 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-26 04:01:01,955 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-26 04:01:01,964 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-26 04:01:02,608 WARN [Thread-381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 04:01:02,917 INFO [Thread-381] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 04:01:02,922 INFO [Thread-381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_42289_jobhistory____.rshwni/webapp 2023-09-26 04:01:03,073 INFO [Thread-381] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-26 04:01:03,074 INFO [Thread-381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-26 04:01:03,074 INFO [Thread-381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-26 04:01:03,076 INFO [Thread-381] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-26 04:01:03,150 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:03,419 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:03,687 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-26 04:01:03,714 INFO [Thread-381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:42289 2023-09-26 04:01:04,089 WARN [Listener at jenkins-hbase20.apache.org/37571] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 04:01:04,321 WARN [Listener at jenkins-hbase20.apache.org/37571] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-26 04:01:04,322 INFO [Listener at jenkins-hbase20.apache.org/37571] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 04:01:04,330 INFO [Listener at jenkins-hbase20.apache.org/37571] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_34395_cluster____kyrn7m/webapp 2023-09-26 04:01:04,394 INFO [Listener at jenkins-hbase20.apache.org/37571] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-26 04:01:04,394 INFO [Listener at jenkins-hbase20.apache.org/37571] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-26 04:01:04,394 INFO [Listener at jenkins-hbase20.apache.org/37571] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-26 04:01:04,395 INFO [Listener at jenkins-hbase20.apache.org/37571] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-26 04:01:04,403 INFO [Listener at jenkins-hbase20.apache.org/37571] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:04,586 INFO [Listener at jenkins-hbase20.apache.org/37571] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:04,692 INFO [Listener at jenkins-hbase20.apache.org/37571] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:04,700 INFO [Listener at jenkins-hbase20.apache.org/37571] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:34395 2023-09-26 04:01:05,104 WARN [Listener at jenkins-hbase20.apache.org/44437] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 04:01:05,125 WARN [Listener at jenkins-hbase20.apache.org/44437] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-26 04:01:05,126 INFO [Listener at jenkins-hbase20.apache.org/44437] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 04:01:05,132 INFO [Listener at jenkins-hbase20.apache.org/44437] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_35507_node____8fsxf0/webapp 2023-09-26 04:01:05,174 INFO [Listener at jenkins-hbase20.apache.org/44437] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-26 04:01:05,175 INFO [Listener at jenkins-hbase20.apache.org/44437] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-26 04:01:05,175 INFO [Listener at jenkins-hbase20.apache.org/44437] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-26 04:01:05,175 INFO [Listener at jenkins-hbase20.apache.org/44437] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-26 04:01:05,182 INFO [Listener at jenkins-hbase20.apache.org/44437] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:05,200 INFO [Listener at jenkins-hbase20.apache.org/44437] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:05,267 INFO [Listener at jenkins-hbase20.apache.org/44437] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:05,278 INFO [Listener at jenkins-hbase20.apache.org/44437] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:35507 2023-09-26 04:01:05,486 WARN [Listener at jenkins-hbase20.apache.org/39825] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-26 04:01:05,491 WARN [Listener at jenkins-hbase20.apache.org/39825] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-26 04:01:05,492 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): jetty-6.1.26 2023-09-26 04:01:05,498 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_39927_node____xo092i/webapp 2023-09-26 04:01:05,541 INFO [Listener at jenkins-hbase20.apache.org/39825] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-26 04:01:05,541 INFO [Listener at jenkins-hbase20.apache.org/39825] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-26 04:01:05,541 INFO [Listener at jenkins-hbase20.apache.org/39825] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-26 04:01:05,541 INFO [Listener at jenkins-hbase20.apache.org/39825] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-26 04:01:05,549 INFO [Listener at jenkins-hbase20.apache.org/39825] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:05,561 INFO [Listener at jenkins-hbase20.apache.org/39825] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:05,623 INFO [Listener at jenkins-hbase20.apache.org/39825] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-26 04:01:05,629 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:39927 2023-09-26 04:01:05,649 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-26 04:01:05,651 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:01:05,718 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=893, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=163, AvailableMemoryMB=8523 2023-09-26 04:01:05,718 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-09-26 04:01:05,733 DEBUG [Listener at jenkins-hbase20.apache.org/39825] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-26 04:01:05,740 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-26 04:01:05,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 04:01:05,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-26 04:01:05,754 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 04:01:05,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-26 04:01:05,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 04:01:05,758 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 04:01:05,762 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:05,762 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:05,764 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3 empty. 2023-09-26 04:01:05,765 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e empty. 2023-09-26 04:01:05,767 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:05,767 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:05,767 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-26 04:01:05,805 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-26 04:01:05,807 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 37efa46e91b4466c4ad925df43b929e3, NAME => 'testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:01:05,808 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => a10ad63d56cd85b22f62fcd596a8245e, NAME => 'testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:01:05,846 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:05,846 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing a10ad63d56cd85b22f62fcd596a8245e, disabling compactions & flushes 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 37efa46e91b4466c4ad925df43b929e3, disabling compactions & flushes 2023-09-26 04:01:05,848 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:05,848 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. after waiting 0 ms 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. after waiting 0 ms 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:05,848 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:05,848 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for a10ad63d56cd85b22f62fcd596a8245e: 2023-09-26 04:01:05,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 37efa46e91b4466c4ad925df43b929e3: 2023-09-26 04:01:05,852 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 04:01:05,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700865853"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700865853"}]},"ts":"1695700865853"} 2023-09-26 04:01:05,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700865853"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700865853"}]},"ts":"1695700865853"} 2023-09-26 04:01:05,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 04:01:05,892 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 04:01:05,908 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 04:01:05,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 04:01:05,915 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700865913"}]},"ts":"1695700865913"} 2023-09-26 04:01:05,921 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-26 04:01:05,928 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:01:05,930 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:01:05,930 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:01:05,930 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:01:05,930 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:01:05,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37efa46e91b4466c4ad925df43b929e3, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a10ad63d56cd85b22f62fcd596a8245e, ASSIGN}] 2023-09-26 04:01:05,933 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37efa46e91b4466c4ad925df43b929e3, ASSIGN 2023-09-26 04:01:05,933 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a10ad63d56cd85b22f62fcd596a8245e, ASSIGN 2023-09-26 04:01:05,935 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a10ad63d56cd85b22f62fcd596a8245e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44553,1695700858629; forceNewPlan=false, retain=false 2023-09-26 04:01:05,935 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37efa46e91b4466c4ad925df43b929e3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34445,1695700858593; forceNewPlan=false, retain=false 2023-09-26 04:01:06,047 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-26 04:01:06,049 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-26 04:01:06,049 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-26 04:01:06,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 04:01:06,085 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 04:01:06,087 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=37efa46e91b4466c4ad925df43b929e3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:06,087 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a10ad63d56cd85b22f62fcd596a8245e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:06,088 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700866087"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700866087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700866087"}]},"ts":"1695700866087"} 2023-09-26 04:01:06,088 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700866087"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700866087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700866087"}]},"ts":"1695700866087"} 2023-09-26 04:01:06,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 37efa46e91b4466c4ad925df43b929e3, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:01:06,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure a10ad63d56cd85b22f62fcd596a8245e, server=jenkins-hbase20.apache.org,44553,1695700858629}] 2023-09-26 04:01:06,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:06,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:06,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a10ad63d56cd85b22f62fcd596a8245e, NAME => 'testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 04:01:06,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37efa46e91b4466c4ad925df43b929e3, NAME => 'testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. service=AccessControlService 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. service=AccessControlService 2023-09-26 04:01:06,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:01:06,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:06,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:06,257 INFO [StoreOpener-a10ad63d56cd85b22f62fcd596a8245e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:06,257 INFO [StoreOpener-37efa46e91b4466c4ad925df43b929e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:06,259 DEBUG [StoreOpener-37efa46e91b4466c4ad925df43b929e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/cf 2023-09-26 04:01:06,259 DEBUG [StoreOpener-a10ad63d56cd85b22f62fcd596a8245e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/cf 2023-09-26 04:01:06,259 DEBUG [StoreOpener-a10ad63d56cd85b22f62fcd596a8245e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/cf 2023-09-26 04:01:06,259 DEBUG [StoreOpener-37efa46e91b4466c4ad925df43b929e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/cf 2023-09-26 04:01:06,262 INFO [StoreOpener-a10ad63d56cd85b22f62fcd596a8245e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a10ad63d56cd85b22f62fcd596a8245e columnFamilyName cf 2023-09-26 04:01:06,262 INFO [StoreOpener-37efa46e91b4466c4ad925df43b929e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37efa46e91b4466c4ad925df43b929e3 columnFamilyName cf 2023-09-26 04:01:06,265 INFO [StoreOpener-37efa46e91b4466c4ad925df43b929e3-1] regionserver.HStore(310): Store=37efa46e91b4466c4ad925df43b929e3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:06,265 INFO [StoreOpener-a10ad63d56cd85b22f62fcd596a8245e-1] regionserver.HStore(310): Store=a10ad63d56cd85b22f62fcd596a8245e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:06,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:06,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:06,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:06,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:06,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:06,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:06,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:01:06,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:01:06,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 37efa46e91b4466c4ad925df43b929e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67649296, jitterRate=0.008053064346313477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:01:06,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 37efa46e91b4466c4ad925df43b929e3: 2023-09-26 04:01:06,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a10ad63d56cd85b22f62fcd596a8245e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62862268, jitterRate=-0.06327921152114868}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:01:06,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a10ad63d56cd85b22f62fcd596a8245e: 2023-09-26 04:01:06,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3., pid=15, masterSystemTime=1695700866244 2023-09-26 04:01:06,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e., pid=16, masterSystemTime=1695700866245 2023-09-26 04:01:06,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:06,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:06,291 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=37efa46e91b4466c4ad925df43b929e3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:06,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:06,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:06,292 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700866291"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700866291"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700866291"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700866291"}]},"ts":"1695700866291"} 2023-09-26 04:01:06,293 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a10ad63d56cd85b22f62fcd596a8245e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:06,293 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700866292"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700866292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700866292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700866292"}]},"ts":"1695700866292"} 2023-09-26 04:01:06,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-26 04:01:06,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 37efa46e91b4466c4ad925df43b929e3, server=jenkins-hbase20.apache.org,34445,1695700858593 in 204 msec 2023-09-26 04:01:06,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-26 04:01:06,306 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37efa46e91b4466c4ad925df43b929e3, ASSIGN in 369 msec 2023-09-26 04:01:06,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure a10ad63d56cd85b22f62fcd596a8245e, server=jenkins-hbase20.apache.org,44553,1695700858629 in 206 msec 2023-09-26 04:01:06,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-26 04:01:06,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a10ad63d56cd85b22f62fcd596a8245e, ASSIGN in 376 msec 2023-09-26 04:01:06,310 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 04:01:06,311 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700866311"}]},"ts":"1695700866311"} 2023-09-26 04:01:06,313 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-26 04:01:06,316 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 04:01:06,322 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-26 04:01:06,331 DEBUG [hconnection-0x644acdf5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:06,333 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-26 04:01:06,340 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-26 04:01:06,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 04:01:06,364 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:06,364 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:06,364 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:06,364 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:06,364 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:01:06,370 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:06,370 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:06,370 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:06,370 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:06,373 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 622 msec 2023-09-26 04:01:06,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-26 04:01:06,866 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-26 04:01:06,870 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-26 04:01:06,871 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:06,873 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:01:06,894 DEBUG [hconnection-0x505f8408-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:06,897 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:06,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 04:01:06,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700866914 (current time:1695700866914). 2023-09-26 04:01:06,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:01:06,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x159957cb to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:06,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@235b35ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:06,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:06,924 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:06,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x159957cb to 127.0.0.1:55155 2023-09-26 04:01:06,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:06,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x66b30f42 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:06,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@353416b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:06,942 DEBUG [hconnection-0x4b3025f3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:06,945 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:06,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:06,953 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:06,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66b30f42 to 127.0.0.1:55155 2023-09-26 04:01:06,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:06,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-26 04:01:06,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:01:06,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 04:01:06,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 04:01:06,994 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 04:01:06,995 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695701466995 2023-09-26 04:01:06,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 04:01:06,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-26 04:01:06,999 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 04:01:07,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 04:01:07,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-26 04:01:07,002 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 04:01:07,003 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695701467003 2023-09-26 04:01:07,003 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:01:07,004 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:01:07,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,030 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-26 04:01:07,030 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:07,031 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-26 04:01:07,031 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-26 04:01:07,032 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,032 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,034 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,034 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,034 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,034 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,035 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,035 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,036 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,036 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:01:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-26 04:01:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-26 04:01:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-26 04:01:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 04:01:07,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 04:01:07,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 04:01:07,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,041 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 04:01:07,041 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 04:01:07,041 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:07,041 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:07,042 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 04:01:07,041 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 04:01:07,042 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-26 04:01:07,042 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 04:01:07,042 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-26 04:01:07,042 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-26 04:01:07,042 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:07,042 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-26 04:01:07,043 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 04:01:07,043 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-26 04:01:07,043 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-26 04:01:07,049 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,049 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,049 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,049 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,049 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,049 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,049 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:07,049 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,049 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:07,049 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,049 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-26 04:01:07,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54debaf5[Count = 1] remaining members to acquire global barrier 2023-09-26 04:01:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-26 04:01:07,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54debaf5[Count = 0] remaining members to acquire global barrier 2023-09-26 04:01:07,054 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-26 04:01:07,054 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,056 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,056 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,056 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,057 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 04:01:07,057 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,057 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 04:01:07,057 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 04:01:07,057 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,057 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-26 04:01:07,057 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:01:07,057 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:01:07,058 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:07,058 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:07,058 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:07,058 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. started... 2023-09-26 04:01:07,061 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37efa46e91b4466c4ad925df43b929e3: 2023-09-26 04:01:07,062 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,062 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:07,063 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:07,063 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:07,064 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. started... 2023-09-26 04:01:07,064 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 04:01:07,064 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:07,064 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-26 04:01:07,065 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a10ad63d56cd85b22f62fcd596a8245e: 2023-09-26 04:01:07,065 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,070 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:07,070 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:07,075 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:01:07,075 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:01:07,104 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:07,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 04:01:07,111 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. completed. 2023-09-26 04:01:07,111 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:07,111 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:07,111 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:07,111 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,112 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-26 04:01:07,112 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:01:07,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:01:07,113 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 04:01:07,113 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,113 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:07,113 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-26 04:01:07,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,115 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. completed. 2023-09-26 04:01:07,115 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:07,116 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:07,116 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:07,116 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,116 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:01:07,116 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-26 04:01:07,116 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:01:07,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,117 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,118 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 04:01:07,118 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:07,118 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-26 04:01:07,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44553,1695700858629': 2023-09-26 04:01:07,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-26 04:01:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:01:07,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-26 04:01:07,127 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-26 04:01:07,127 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:01:07,127 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:01:07,127 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,127 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:01:07,132 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,132 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,132 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,132 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,132 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,132 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,132 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,133 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,133 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,134 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,138 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,139 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,139 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,153 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,153 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,153 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,153 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,153 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,153 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,153 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,153 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,153 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,154 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,154 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:07,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,154 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-26 04:01:07,154 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,156 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,156 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:01:07,156 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,156 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,156 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 04:01:07,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,231 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-26 04:01:07,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,232 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:07,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695700866995Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695700867175 (+180 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695700867175Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695700867175Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695700867187 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695700867211 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695700867231 (+20 ms) 2023-09-26 04:01:07,235 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 04:01:07,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 238 msec 2023-09-26 04:01:07,316 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:07,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 04:01:07,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:01:07,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34445] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:01:07,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44553] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:01:07,342 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-26 04:01:07,342 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:07,342 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:01:07,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 04:01:07,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700867360 (current time:1695700867360). 2023-09-26 04:01:07,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:01:07,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x37bee01c to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:07,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a3f74da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:07,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:07,372 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:07,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37bee01c to 127.0.0.1:55155 2023-09-26 04:01:07,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:07,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x3c6de3f4 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:07,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c935a65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:07,387 DEBUG [hconnection-0x1d6b6889-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:07,388 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:07,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:07,395 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:07,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c6de3f4 to 127.0.0.1:55155 2023-09-26 04:01:07,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:07,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-26 04:01:07,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:01:07,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 04:01:07,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 04:01:07,402 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 04:01:07,404 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695701467404 2023-09-26 04:01:07,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-26 04:01:07,404 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-26 04:01:07,405 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:01:07,406 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:01:07,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 04:01:07,407 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-26 04:01:07,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-26 04:01:07,411 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 04:01:07,412 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695701467412 2023-09-26 04:01:07,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-26 04:01:07,430 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-26 04:01:07,430 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:07,431 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-26 04:01:07,431 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-26 04:01:07,432 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,432 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,433 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,433 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,433 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,433 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,433 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,433 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,434 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,434 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 04:01:07,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-26 04:01:07,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-26 04:01:07,435 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 04:01:07,435 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 04:01:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-26 04:01:07,438 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,438 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:07,439 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 04:01:07,440 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-26 04:01:07,439 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 04:01:07,440 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-26 04:01:07,440 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-26 04:01:07,440 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-26 04:01:07,440 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-26 04:01:07,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-26 04:01:07,440 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-26 04:01:07,440 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:07,441 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-26 04:01:07,441 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-26 04:01:07,441 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-26 04:01:07,449 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,449 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,449 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,449 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,449 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:07,449 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,449 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,449 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,450 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:07,450 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,450 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:07,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 04:01:07,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-26 04:01:07,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@550f350c[Count = 1] remaining members to acquire global barrier 2023-09-26 04:01:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 04:01:07,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-26 04:01:07,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@550f350c[Count = 0] remaining members to acquire global barrier 2023-09-26 04:01:07,454 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-26 04:01:07,454 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 04:01:07,456 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,456 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 04:01:07,456 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:07,456 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:07,456 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-26 04:01:07,456 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:07,456 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-26 04:01:07,457 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. started... 2023-09-26 04:01:07,457 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:07,457 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:07,457 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,457 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:01:07,457 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:07,457 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:01:07,457 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. started... 2023-09-26 04:01:07,457 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 37efa46e91b4466c4ad925df43b929e3 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-26 04:01:07,457 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a10ad63d56cd85b22f62fcd596a8245e 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-26 04:01:07,459 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 04:01:07,459 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:07,459 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-26 04:01:07,506 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:07,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 04:01:07,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:01:07,507 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:01:07,589 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230926a60c9538171244e7be9221c79aca1e5b to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230926a60c9538171244e7be9221c79aca1e5b 2023-09-26 04:01:07,589 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309266d57fc38a7cf46e49fbeaec941eed970 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309266d57fc38a7cf46e49fbeaec941eed970 2023-09-26 04:01:07,616 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/.tmp/cf/ea1dc536919546788ec37203fc9a92d8 2023-09-26 04:01:07,616 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/.tmp/cf/15fcd303ae4e46299967c07c3f7f4f45 2023-09-26 04:01:07,628 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/.tmp/cf/ea1dc536919546788ec37203fc9a92d8 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/cf/ea1dc536919546788ec37203fc9a92d8 2023-09-26 04:01:07,628 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/.tmp/cf/15fcd303ae4e46299967c07c3f7f4f45 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/cf/15fcd303ae4e46299967c07c3f7f4f45 2023-09-26 04:01:07,639 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/cf/ea1dc536919546788ec37203fc9a92d8, entries=46, sequenceid=6, filesize=12.6 K 2023-09-26 04:01:07,639 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/cf/15fcd303ae4e46299967c07c3f7f4f45, entries=4, sequenceid=6, filesize=5.6 K 2023-09-26 04:01:07,644 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a10ad63d56cd85b22f62fcd596a8245e in 186ms, sequenceid=6, compaction requested=false 2023-09-26 04:01:07,644 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 37efa46e91b4466c4ad925df43b929e3 in 187ms, sequenceid=6, compaction requested=false 2023-09-26 04:01:07,644 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-26 04:01:07,644 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-26 04:01:07,646 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37efa46e91b4466c4ad925df43b929e3: 2023-09-26 04:01:07,646 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a10ad63d56cd85b22f62fcd596a8245e: 2023-09-26 04:01:07,647 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-26 04:01:07,647 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-26 04:01:07,647 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:07,647 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:07,647 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/cf/ea1dc536919546788ec37203fc9a92d8] hfiles 2023-09-26 04:01:07,647 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/cf/15fcd303ae4e46299967c07c3f7f4f45] hfiles 2023-09-26 04:01:07,647 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/cf/ea1dc536919546788ec37203fc9a92d8 for snapshot=snaptb0-testExportWithTargetName 2023-09-26 04:01:07,647 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/cf/15fcd303ae4e46299967c07c3f7f4f45 for snapshot=snaptb0-testExportWithTargetName 2023-09-26 04:01:07,673 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. completed. 2023-09-26 04:01:07,673 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:07,673 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:07,673 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:07,673 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,673 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-26 04:01:07,673 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:01:07,675 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:01:07,675 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,675 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 04:01:07,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,675 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:07,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,675 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-26 04:01:07,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,677 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-26 04:01:07,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,677 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:01:07,677 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-26 04:01:07,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,677 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. completed. 2023-09-26 04:01:07,677 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-26 04:01:07,677 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:07,677 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-26 04:01:07,677 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:07,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 04:01:07,678 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:07,678 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:01:07,678 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-26 04:01:07,678 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,678 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-26 04:01:07,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,678 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-26 04:01:07,678 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-26 04:01:07,678 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:01:07,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,679 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,679 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-26 04:01:07,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,679 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:07,679 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-26 04:01:07,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 04:01:07,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:01:07,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-26 04:01:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 04:01:07,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 04:01:07,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44553,1695700858629': 2023-09-26 04:01:07,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-26 04:01:07,686 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-26 04:01:07,686 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:01:07,687 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:01:07,687 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-26 04:01:07,687 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:01:07,699 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:07,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,699 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:07,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,700 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:07,700 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 04:01:07,700 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:07,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 04:01:07,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,706 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:07,707 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-26 04:01:07,707 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,708 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 04:01:07,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:01:07,709 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,721 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-26 04:01:07,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,721 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:07,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:07,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:07,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,721 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-26 04:01:07,723 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,723 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:07,723 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,723 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:07,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-26 04:01:07,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,723 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:07,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:01:07,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:07,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:07,723 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,724 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309266d57fc38a7cf46e49fbeaec941eed970, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230926a60c9538171244e7be9221c79aca1e5b] mob files 2023-09-26 04:01:07,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309266d57fc38a7cf46e49fbeaec941eed970 2023-09-26 04:01:07,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230926a60c9538171244e7be9221c79aca1e5b 2023-09-26 04:01:07,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-26 04:01:07,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-26 04:01:07,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,782 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-26 04:01:07,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695700867404Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695700867743 (+339 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695700867743Loading Region manifests for snaptb0-testExportWithTargetName at 1695700867743Writing data manifest for snaptb0-testExportWithTargetName at 1695700867748 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695700867770 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695700867781 (+11 ms) 2023-09-26 04:01:07,784 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-26 04:01:07,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 380 msec 2023-09-26 04:01:08,010 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:08,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-26 04:01:08,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:01:08,013 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013 2023-09-26 04:01:08,014 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36857, tgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013, rawTgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013, srcFsUri=hdfs://localhost:36857, srcDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:01:08,060 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:01:08,060 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_186345351_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-26 04:01:08,060 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa, snapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-26 04:01:08,080 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-26 04:01:08,146 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,147 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,148 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,148 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,932 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-2404483772919562438.jar 2023-09-26 04:01:08,933 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,933 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,990 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-1373043975100090185.jar 2023-09-26 04:01:08,990 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,991 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,991 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,992 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,992 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,992 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:08,993 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 04:01:08,993 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 04:01:08,994 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 04:01:08,994 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 04:01:08,994 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 04:01:08,995 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 04:01:08,996 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 04:01:08,996 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 04:01:08,997 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 04:01:08,998 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 04:01:09,002 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:09,003 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:09,004 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:09,004 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:09,004 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:09,005 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:09,006 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:09,760 WARN [Listener at jenkins-hbase20.apache.org/39825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 04:01:09,765 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-26 04:01:09,774 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-26 04:01:10,183 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:01:10,184 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:01:10,552 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0001_000001 (auth:SIMPLE) 2023-09-26 04:01:11,757 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 04:01:14,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0001_000001 (auth:SIMPLE) 2023-09-26 04:01:16,685 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0001_000001 (auth:SIMPLE) 2023-09-26 04:01:19,527 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0001_000001 (auth:SIMPLE) 2023-09-26 04:01:19,547 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695700864748_0001_01_000002 is : 143 2023-09-26 04:01:21,553 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 04:01:21,557 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 04:01:21,571 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-26 04:01:21,571 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 04:01:21,572 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 04:01:21,572 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-26 04:01:21,573 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-26 04:01:21,573 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-26 04:01:21,573 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013/.hbase-snapshot/testExportWithTargetName 2023-09-26 04:01:21,573 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-26 04:01:21,573 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700868013/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-26 04:01:21,584 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-26 04:01:21,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-09-26 04:01:21,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-26 04:01:21,601 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700881601"}]},"ts":"1695700881601"} 2023-09-26 04:01:21,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-26 04:01:21,603 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-26 04:01:21,605 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-26 04:01:21,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37efa46e91b4466c4ad925df43b929e3, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a10ad63d56cd85b22f62fcd596a8245e, UNASSIGN}] 2023-09-26 04:01:21,609 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a10ad63d56cd85b22f62fcd596a8245e, UNASSIGN 2023-09-26 04:01:21,609 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37efa46e91b4466c4ad925df43b929e3, UNASSIGN 2023-09-26 04:01:21,610 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a10ad63d56cd85b22f62fcd596a8245e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:21,610 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=37efa46e91b4466c4ad925df43b929e3, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:21,611 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700881610"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700881610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700881610"}]},"ts":"1695700881610"} 2023-09-26 04:01:21,611 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700881610"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700881610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700881610"}]},"ts":"1695700881610"} 2023-09-26 04:01:21,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 37efa46e91b4466c4ad925df43b929e3, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:01:21,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure a10ad63d56cd85b22f62fcd596a8245e, server=jenkins-hbase20.apache.org,44553,1695700858629}] 2023-09-26 04:01:21,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-26 04:01:21,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:21,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 37efa46e91b4466c4ad925df43b929e3, disabling compactions & flushes 2023-09-26 04:01:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a10ad63d56cd85b22f62fcd596a8245e, disabling compactions & flushes 2023-09-26 04:01:21,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:21,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. after waiting 0 ms 2023-09-26 04:01:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. after waiting 0 ms 2023-09-26 04:01:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:21,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:01:21,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:01:21,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:01:21,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:01:21,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3. 2023-09-26 04:01:21,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e. 2023-09-26 04:01:21,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 37efa46e91b4466c4ad925df43b929e3: 2023-09-26 04:01:21,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a10ad63d56cd85b22f62fcd596a8245e: 2023-09-26 04:01:21,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:21,796 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=37efa46e91b4466c4ad925df43b929e3, regionState=CLOSED 2023-09-26 04:01:21,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:21,796 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700881796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700881796"}]},"ts":"1695700881796"} 2023-09-26 04:01:21,797 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a10ad63d56cd85b22f62fcd596a8245e, regionState=CLOSED 2023-09-26 04:01:21,797 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695700881796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700881796"}]},"ts":"1695700881796"} 2023-09-26 04:01:21,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-26 04:01:21,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 37efa46e91b4466c4ad925df43b929e3, server=jenkins-hbase20.apache.org,34445,1695700858593 in 185 msec 2023-09-26 04:01:21,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-26 04:01:21,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure a10ad63d56cd85b22f62fcd596a8245e, server=jenkins-hbase20.apache.org,44553,1695700858629 in 185 msec 2023-09-26 04:01:21,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37efa46e91b4466c4ad925df43b929e3, UNASSIGN in 194 msec 2023-09-26 04:01:21,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-26 04:01:21,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a10ad63d56cd85b22f62fcd596a8245e, UNASSIGN in 195 msec 2023-09-26 04:01:21,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700881804"}]},"ts":"1695700881804"} 2023-09-26 04:01:21,806 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-26 04:01:21,807 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-26 04:01:21,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 217 msec 2023-09-26 04:01:21,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-26 04:01:21,906 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-26 04:01:21,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-09-26 04:01:21,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 04:01:21,918 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 04:01:21,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-26 04:01:21,921 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 04:01:21,924 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-26 04:01:21,926 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 04:01:21,926 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 04:01:21,926 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 04:01:21,926 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-26 04:01:21,927 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:21,927 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:21,927 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:21,927 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:21,927 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:21,927 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:21,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-26 04:01:21,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-26 04:01:21,928 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 04:01:21,928 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 04:01:21,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-26 04:01:21,928 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 04:01:21,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-26 04:01:21,929 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 04:01:21,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-26 04:01:21,955 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/recovered.edits] 2023-09-26 04:01:21,955 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/recovered.edits] 2023-09-26 04:01:21,961 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/cf/15fcd303ae4e46299967c07c3f7f4f45 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/cf/15fcd303ae4e46299967c07c3f7f4f45 2023-09-26 04:01:21,961 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/cf/ea1dc536919546788ec37203fc9a92d8 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/cf/ea1dc536919546788ec37203fc9a92d8 2023-09-26 04:01:21,965 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e/recovered.edits/9.seqid 2023-09-26 04:01:21,965 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3/recovered.edits/9.seqid 2023-09-26 04:01:21,966 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/a10ad63d56cd85b22f62fcd596a8245e 2023-09-26 04:01:21,966 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportWithTargetName/37efa46e91b4466c4ad925df43b929e3 2023-09-26 04:01:21,966 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-26 04:01:21,966 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-26 04:01:21,967 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-26 04:01:21,971 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309266d57fc38a7cf46e49fbeaec941eed970 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309266d57fc38a7cf46e49fbeaec941eed970 2023-09-26 04:01:21,972 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230926a60c9538171244e7be9221c79aca1e5b to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230926a60c9538171244e7be9221c79aca1e5b 2023-09-26 04:01:21,973 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-26 04:01:21,975 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 04:01:21,993 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-26 04:01:21,996 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-26 04:01:21,997 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 04:01:21,997 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-26 04:01:21,998 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700881997"}]},"ts":"9223372036854775807"} 2023-09-26 04:01:21,998 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700881997"}]},"ts":"9223372036854775807"} 2023-09-26 04:01:22,000 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 04:01:22,000 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 37efa46e91b4466c4ad925df43b929e3, NAME => 'testtb-testExportWithTargetName,,1695700865748.37efa46e91b4466c4ad925df43b929e3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a10ad63d56cd85b22f62fcd596a8245e, NAME => 'testtb-testExportWithTargetName,1,1695700865748.a10ad63d56cd85b22f62fcd596a8245e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 04:01:22,000 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-26 04:01:22,000 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695700882000"}]},"ts":"9223372036854775807"} 2023-09-26 04:01:22,002 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-26 04:01:22,004 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-26 04:01:22,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 93 msec 2023-09-26 04:01:22,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-26 04:01:22,057 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-26 04:01:22,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-26 04:01:22,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-26 04:01:22,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-09-26 04:01:22,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-26 04:01:22,115 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 704) Potentially hanging thread: IPC Client (1542791596) connection to jenkins-hbase20.apache.org/148.251.75.209:39825 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-361514207_1 at /127.0.0.1:48818 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:33638 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1278 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1542791596) connection to jenkins-hbase20.apache.org/148.251.75.209:44437 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:36034 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1542791596) connection to jenkins-hbase20.apache.org/148.251.75.209:43449 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1542791596) connection to jenkins-hbase20.apache.org/148.251.75.209:33857 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:48850 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 893) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=198 (was 173) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 163) - ProcessCount LEAK? -, AvailableMemoryMB=7795 (was 8523) 2023-09-26 04:01:22,115 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-26 04:01:22,134 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=198, ProcessCount=166, AvailableMemoryMB=7795 2023-09-26 04:01:22,134 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-26 04:01:22,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 04:01:22,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-26 04:01:22,142 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 04:01:22,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-26 04:01:22,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-26 04:01:22,145 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 04:01:22,148 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:22,148 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:22,149 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98 empty. 2023-09-26 04:01:22,149 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a empty. 2023-09-26 04:01:22,149 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:22,149 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:22,150 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-26 04:01:22,161 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-26 04:01:22,162 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 030c3ad284a6d80318feb810686f5e98, NAME => 'testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:01:22,162 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8174ae4a59dfaaf4e5c97545fb00d55a, NAME => 'testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:01:22,184 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:22,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 030c3ad284a6d80318feb810686f5e98, disabling compactions & flushes 2023-09-26 04:01:22,186 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:22,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:22,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. after waiting 0 ms 2023-09-26 04:01:22,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:22,186 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:22,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 030c3ad284a6d80318feb810686f5e98: 2023-09-26 04:01:22,187 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:22,189 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8174ae4a59dfaaf4e5c97545fb00d55a, disabling compactions & flushes 2023-09-26 04:01:22,189 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,189 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,189 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. after waiting 0 ms 2023-09-26 04:01:22,189 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,189 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,189 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8174ae4a59dfaaf4e5c97545fb00d55a: 2023-09-26 04:01:22,193 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 04:01:22,194 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700882193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700882193"}]},"ts":"1695700882193"} 2023-09-26 04:01:22,194 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700882193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700882193"}]},"ts":"1695700882193"} 2023-09-26 04:01:22,196 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 04:01:22,198 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 04:01:22,198 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700882198"}]},"ts":"1695700882198"} 2023-09-26 04:01:22,200 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-26 04:01:22,202 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:01:22,203 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:01:22,203 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:01:22,203 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:01:22,203 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:01:22,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8174ae4a59dfaaf4e5c97545fb00d55a, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=030c3ad284a6d80318feb810686f5e98, ASSIGN}] 2023-09-26 04:01:22,206 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=030c3ad284a6d80318feb810686f5e98, ASSIGN 2023-09-26 04:01:22,206 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8174ae4a59dfaaf4e5c97545fb00d55a, ASSIGN 2023-09-26 04:01:22,208 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8174ae4a59dfaaf4e5c97545fb00d55a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43719,1695700858548; forceNewPlan=false, retain=false 2023-09-26 04:01:22,208 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=030c3ad284a6d80318feb810686f5e98, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34445,1695700858593; forceNewPlan=false, retain=false 2023-09-26 04:01:22,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-26 04:01:22,358 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 04:01:22,360 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8174ae4a59dfaaf4e5c97545fb00d55a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,360 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=030c3ad284a6d80318feb810686f5e98, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,360 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700882360"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700882360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700882360"}]},"ts":"1695700882360"} 2023-09-26 04:01:22,360 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700882360"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700882360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700882360"}]},"ts":"1695700882360"} 2023-09-26 04:01:22,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 030c3ad284a6d80318feb810686f5e98, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:01:22,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 8174ae4a59dfaaf4e5c97545fb00d55a, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:01:22,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-26 04:01:22,518 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,518 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 04:01:22,523 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 04:01:22,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:22,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 030c3ad284a6d80318feb810686f5e98, NAME => 'testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 04:01:22,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. service=AccessControlService 2023-09-26 04:01:22,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:01:22,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:22,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:22,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:22,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:22,531 INFO [StoreOpener-030c3ad284a6d80318feb810686f5e98-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:22,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8174ae4a59dfaaf4e5c97545fb00d55a, NAME => 'testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 04:01:22,533 DEBUG [StoreOpener-030c3ad284a6d80318feb810686f5e98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/cf 2023-09-26 04:01:22,533 DEBUG [StoreOpener-030c3ad284a6d80318feb810686f5e98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/cf 2023-09-26 04:01:22,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. service=AccessControlService 2023-09-26 04:01:22,533 INFO [StoreOpener-030c3ad284a6d80318feb810686f5e98-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 030c3ad284a6d80318feb810686f5e98 columnFamilyName cf 2023-09-26 04:01:22,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:01:22,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:22,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:22,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:22,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:22,535 INFO [StoreOpener-8174ae4a59dfaaf4e5c97545fb00d55a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:22,536 INFO [StoreOpener-030c3ad284a6d80318feb810686f5e98-1] regionserver.HStore(310): Store=030c3ad284a6d80318feb810686f5e98/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:22,538 DEBUG [StoreOpener-8174ae4a59dfaaf4e5c97545fb00d55a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/cf 2023-09-26 04:01:22,538 DEBUG [StoreOpener-8174ae4a59dfaaf4e5c97545fb00d55a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/cf 2023-09-26 04:01:22,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:22,538 INFO [StoreOpener-8174ae4a59dfaaf4e5c97545fb00d55a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8174ae4a59dfaaf4e5c97545fb00d55a columnFamilyName cf 2023-09-26 04:01:22,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:22,540 INFO [StoreOpener-8174ae4a59dfaaf4e5c97545fb00d55a-1] regionserver.HStore(310): Store=8174ae4a59dfaaf4e5c97545fb00d55a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:22,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:22,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:22,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:22,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:01:22,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:22,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 030c3ad284a6d80318feb810686f5e98; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59566105, jitterRate=-0.11239586770534515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:01:22,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 030c3ad284a6d80318feb810686f5e98: 2023-09-26 04:01:22,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98., pid=30, masterSystemTime=1695700882515 2023-09-26 04:01:22,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:22,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:22,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:01:22,552 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=030c3ad284a6d80318feb810686f5e98, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,552 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700882552"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700882552"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700882552"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700882552"}]},"ts":"1695700882552"} 2023-09-26 04:01:22,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8174ae4a59dfaaf4e5c97545fb00d55a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69577182, jitterRate=0.03678080439567566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:01:22,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8174ae4a59dfaaf4e5c97545fb00d55a: 2023-09-26 04:01:22,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a., pid=31, masterSystemTime=1695700882518 2023-09-26 04:01:22,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8174ae4a59dfaaf4e5c97545fb00d55a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,563 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700882562"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700882562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700882562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700882562"}]},"ts":"1695700882562"} 2023-09-26 04:01:22,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-26 04:01:22,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 030c3ad284a6d80318feb810686f5e98, server=jenkins-hbase20.apache.org,34445,1695700858593 in 195 msec 2023-09-26 04:01:22,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=030c3ad284a6d80318feb810686f5e98, ASSIGN in 361 msec 2023-09-26 04:01:22,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-26 04:01:22,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 8174ae4a59dfaaf4e5c97545fb00d55a, server=jenkins-hbase20.apache.org,43719,1695700858548 in 202 msec 2023-09-26 04:01:22,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-26 04:01:22,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8174ae4a59dfaaf4e5c97545fb00d55a, ASSIGN in 369 msec 2023-09-26 04:01:22,576 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 04:01:22,576 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700882576"}]},"ts":"1695700882576"} 2023-09-26 04:01:22,578 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-26 04:01:22,581 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 04:01:22,581 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-26 04:01:22,583 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 04:01:22,585 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:22,585 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:22,585 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:22,585 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:22,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:22,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:22,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:22,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:22,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 448 msec 2023-09-26 04:01:22,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-26 04:01:22,750 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-26 04:01:22,753 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-26 04:01:22,753 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,756 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:01:22,769 DEBUG [hconnection-0x505f8408-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:22,775 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:22,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:01:22,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700882784 (current time:1695700882784). 2023-09-26 04:01:22,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:01:22,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x78fb1eac to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:22,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19ae7236, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:22,796 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:22,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78fb1eac to 127.0.0.1:55155 2023-09-26 04:01:22,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:22,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x016af71c to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:22,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21c497e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:22,807 DEBUG [hconnection-0x4b916e2f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:22,808 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:22,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:22,817 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:22,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x016af71c to 127.0.0.1:55155 2023-09-26 04:01:22,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:22,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 04:01:22,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:01:22,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:01:22,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:01:22,824 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:01:22,829 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695701482829 2023-09-26 04:01:22,829 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-26 04:01:22,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:01:22,832 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:01:22,832 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:01:22,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 04:01:22,834 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:01:22,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-09-26 04:01:22,838 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 04:01:22,839 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695701482839 2023-09-26 04:01:22,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,855 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-26 04:01:22,855 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:22,856 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-26 04:01:22,856 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-26 04:01:22,857 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,857 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,858 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:22,858 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:22,858 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:22,858 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:22,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:22,858 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,858 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,859 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,859 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 04:01:22,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 04:01:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-26 04:01:22,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,860 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 04:01:22,860 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 04:01:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,860 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:22,860 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:22,861 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 04:01:22,863 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-26 04:01:22,863 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-26 04:01:22,860 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 04:01:22,862 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 04:01:22,863 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-26 04:01:22,863 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-26 04:01:22,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,863 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 04:01:22,863 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:22,864 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 04:01:22,864 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-26 04:01:22,864 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-26 04:01:22,867 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,867 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:22,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:22,868 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:22,868 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,868 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:22,869 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,869 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:22,869 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,869 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,869 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,869 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:22,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:22,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:22,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-26 04:01:22,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@872d2f3[Count = 1] remaining members to acquire global barrier 2023-09-26 04:01:22,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:22,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:22,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-26 04:01:22,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@872d2f3[Count = 0] remaining members to acquire global barrier 2023-09-26 04:01:22,872 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-26 04:01:22,873 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,873 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,873 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,874 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:01:22,873 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,874 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:01:22,874 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,874 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-26 04:01:22,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,874 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:22,874 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,874 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:01:22,874 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. started... 2023-09-26 04:01:22,874 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,874 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:01:22,874 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:22,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,874 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8174ae4a59dfaaf4e5c97545fb00d55a: 2023-09-26 04:01:22,874 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:01:22,874 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:22,874 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:22,874 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:22,874 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,875 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. started... 2023-09-26 04:01:22,875 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:22,875 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:01:22,876 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 030c3ad284a6d80318feb810686f5e98: 2023-09-26 04:01:22,876 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 04:01:22,876 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:22,876 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,876 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-26 04:01:22,878 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:22,878 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:01:22,902 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. completed. 2023-09-26 04:01:22,902 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:22,902 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:22,902 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:22,902 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,902 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-26 04:01:22,902 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:01:22,905 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. completed. 2023-09-26 04:01:22,905 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:22,905 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:22,905 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:22,905 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,905 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-26 04:01:22,905 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:01:22,915 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 04:01:22,915 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,915 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:22,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:22,915 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-26 04:01:22,917 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:22,917 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 04:01:22,917 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:22,917 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-26 04:01:22,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:22,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:22,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:01:22,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-26 04:01:22,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:22,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:22,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:22,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,43719,1695700858548': 2023-09-26 04:01:22,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-26 04:01:22,925 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-26 04:01:22,926 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:01:22,926 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:01:22,926 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,926 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:01:22,932 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 04:01:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:01:22,933 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:01:22,934 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:22,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:22,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,934 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,937 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,937 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,939 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,939 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,939 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,942 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,942 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:22,942 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:22,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:22,942 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:22,942 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,942 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:22,942 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,943 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,943 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:22,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:22,943 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:22,943 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:22,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:22,942 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:22,942 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:22,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:22,943 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:22,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:22,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-26 04:01:22,943 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:22,945 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:22,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,945 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:01:22,945 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:22,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:22,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:22,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:22,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 04:01:22,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,994 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-26 04:01:22,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,995 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:22,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695700882830Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695700882959 (+129 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695700882959Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695700882959Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695700882964 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695700882986 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695700882994 (+8 ms) 2023-09-26 04:01:22,997 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 04:01:22,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 166 msec 2023-09-26 04:01:23,133 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:23,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 04:01:23,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:01:23,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:01:23,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34445] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:01:23,146 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-26 04:01:23,146 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:23,146 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:01:23,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:01:23,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700883161 (current time:1695700883161). 2023-09-26 04:01:23,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:01:23,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x1f8ffe49 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:23,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5faf1b81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:23,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:23,170 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:23,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f8ffe49 to 127.0.0.1:55155 2023-09-26 04:01:23,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:23,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x4fa2dd3f to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:23,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a9ac06f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:23,184 DEBUG [hconnection-0x3debd020-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:23,187 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:23,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:23,195 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:23,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fa2dd3f to 127.0.0.1:55155 2023-09-26 04:01:23,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:23,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 04:01:23,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:01:23,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:01:23,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:01:23,200 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:01:23,202 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695701483202 2023-09-26 04:01:23,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-26 04:01:23,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:01:23,203 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:01:23,203 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:01:23,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 04:01:23,205 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:01:23,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-26 04:01:23,208 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 04:01:23,209 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695701483209 2023-09-26 04:01:23,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-26 04:01:23,219 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-26 04:01:23,219 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:23,220 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-26 04:01:23,220 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-26 04:01:23,220 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,221 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,221 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:23,221 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:23,221 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:23,221 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:23,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:23,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:23,222 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,222 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,222 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,222 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-26 04:01:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-26 04:01:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 04:01:23,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 04:01:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-26 04:01:23,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-26 04:01:23,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-26 04:01:23,223 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 04:01:23,223 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 04:01:23,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-26 04:01:23,223 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:23,223 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-26 04:01:23,224 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 04:01:23,224 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-26 04:01:23,224 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-26 04:01:23,223 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:23,224 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:23,225 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 04:01:23,226 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-26 04:01:23,226 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-26 04:01:23,226 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-26 04:01:23,226 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-26 04:01:23,226 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-26 04:01:23,231 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,231 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,232 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,232 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,232 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:23,232 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,232 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:23,232 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,232 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:23,232 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,232 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 04:01:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-26 04:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@247931a4[Count = 1] remaining members to acquire global barrier 2023-09-26 04:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 04:01:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:23,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-26 04:01:23,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@247931a4[Count = 0] remaining members to acquire global barrier 2023-09-26 04:01:23,236 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-26 04:01:23,236 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:01:23,240 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:01:23,240 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-26 04:01:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,240 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:23,240 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:23,240 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:01:23,240 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,241 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:01:23,240 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:23,240 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:01:23,241 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. started... 2023-09-26 04:01:23,241 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:23,241 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:23,241 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:23,241 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. started... 2023-09-26 04:01:23,241 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8174ae4a59dfaaf4e5c97545fb00d55a 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-26 04:01:23,241 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 030c3ad284a6d80318feb810686f5e98 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-26 04:01:23,241 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 04:01:23,241 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:23,242 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-26 04:01:23,266 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309262869e475d0994d44aa7490a79b28b5dd to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309262869e475d0994d44aa7490a79b28b5dd 2023-09-26 04:01:23,286 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230926c0f3fe798e8c44efb4285618fc73be7c to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926c0f3fe798e8c44efb4285618fc73be7c 2023-09-26 04:01:23,286 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/.tmp/cf/293b67218cae4c3da7ec1d1f002bdb6b 2023-09-26 04:01:23,300 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/.tmp/cf/293b67218cae4c3da7ec1d1f002bdb6b as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/cf/293b67218cae4c3da7ec1d1f002bdb6b 2023-09-26 04:01:23,301 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/.tmp/cf/371ef47b168e4da791ba83ab27ae078b 2023-09-26 04:01:23,304 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:23,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 04:01:23,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:01:23,305 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:01:23,307 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/cf/293b67218cae4c3da7ec1d1f002bdb6b, entries=3, sequenceid=6, filesize=5.4 K 2023-09-26 04:01:23,307 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/.tmp/cf/371ef47b168e4da791ba83ab27ae078b as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/cf/371ef47b168e4da791ba83ab27ae078b 2023-09-26 04:01:23,308 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8174ae4a59dfaaf4e5c97545fb00d55a in 67ms, sequenceid=6, compaction requested=false 2023-09-26 04:01:23,308 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-26 04:01:23,308 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8174ae4a59dfaaf4e5c97545fb00d55a: 2023-09-26 04:01:23,308 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-26 04:01:23,308 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:23,309 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/cf/293b67218cae4c3da7ec1d1f002bdb6b] hfiles 2023-09-26 04:01:23,309 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/cf/293b67218cae4c3da7ec1d1f002bdb6b for snapshot=snaptb0-testExportFileSystemState 2023-09-26 04:01:23,314 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/cf/371ef47b168e4da791ba83ab27ae078b, entries=47, sequenceid=6, filesize=12.8 K 2023-09-26 04:01:23,315 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 030c3ad284a6d80318feb810686f5e98 in 74ms, sequenceid=6, compaction requested=false 2023-09-26 04:01:23,316 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 030c3ad284a6d80318feb810686f5e98: 2023-09-26 04:01:23,317 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-26 04:01:23,317 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:23,317 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/cf/371ef47b168e4da791ba83ab27ae078b] hfiles 2023-09-26 04:01:23,317 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/cf/371ef47b168e4da791ba83ab27ae078b for snapshot=snaptb0-testExportFileSystemState 2023-09-26 04:01:23,322 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. completed. 2023-09-26 04:01:23,322 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:23,322 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:23,323 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:23,323 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,323 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-26 04:01:23,323 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:01:23,325 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,325 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 04:01:23,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:23,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:23,325 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:23,325 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-26 04:01:23,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:23,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 04:01:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:23,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 04:01:23,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,43719,1695700858548': 2023-09-26 04:01:23,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-26 04:01:23,332 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. completed. 2023-09-26 04:01:23,332 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:23,333 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:23,333 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:23,333 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,333 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-26 04:01:23,333 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:01:23,340 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-26 04:01:23,340 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:23,340 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,340 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-26 04:01:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:23,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 04:01:23,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:23,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 04:01:23,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:01:23,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-26 04:01:23,345 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-26 04:01:23,345 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:01:23,345 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:01:23,345 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-26 04:01:23,346 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:01:23,347 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:23,347 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:23,347 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,347 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 04:01:23,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:23,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:23,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:23,348 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 04:01:23,348 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-26 04:01:23,350 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,350 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,350 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,352 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,352 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,352 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,352 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,352 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,353 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:23,353 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:23,353 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:23,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:23,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:23,353 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:23,353 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:23,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:23,353 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:23,353 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:23,353 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-26 04:01:23,353 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:23,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:23,353 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-26 04:01:23,353 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:23,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:23,354 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:23,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-26 04:01:23,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:23,355 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:23,355 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:01:23,355 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926c0f3fe798e8c44efb4285618fc73be7c, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309262869e475d0994d44aa7490a79b28b5dd] mob files 2023-09-26 04:01:23,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926c0f3fe798e8c44efb4285618fc73be7c 2023-09-26 04:01:23,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309262869e475d0994d44aa7490a79b28b5dd 2023-09-26 04:01:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:23,505 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:23,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 04:01:23,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:01:23,507 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-26 04:01:23,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-26 04:01:23,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-26 04:01:23,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,793 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695700883202Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695700883765 (+563 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695700883765Loading Region manifests for snaptb0-testExportFileSystemState at 1695700883765Writing data manifest for snaptb0-testExportFileSystemState at 1695700883769 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695700883783 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695700883792 (+9 ms) 2023-09-26 04:01:23,796 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-26 04:01:23,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 593 msec 2023-09-26 04:01:23,807 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:23,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 04:01:23,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:01:23,809 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809 2023-09-26 04:01:23,809 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36857, tgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809, rawTgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809, srcFsUri=hdfs://localhost:36857, srcDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:01:23,829 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:01:23,829 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1189881510_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,829 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa, snapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-26 04:01:23,843 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-26 04:01:23,878 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:23,878 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:23,879 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:23,879 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:24,616 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-1219804035067878064.jar 2023-09-26 04:01:24,616 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:24,617 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:24,674 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-2101112055608459719.jar 2023-09-26 04:01:24,674 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:24,675 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:24,675 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:24,675 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:24,676 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:24,676 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:24,676 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 04:01:24,677 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 04:01:24,677 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 04:01:24,677 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 04:01:24,678 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 04:01:24,678 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 04:01:24,679 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 04:01:24,679 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 04:01:24,679 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 04:01:24,680 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 04:01:24,680 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:24,680 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:24,681 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:24,681 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:24,681 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:24,682 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:24,682 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:25,137 WARN [Listener at jenkins-hbase20.apache.org/39825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 04:01:25,140 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-26 04:01:25,144 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-26 04:01:25,726 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:01:25,726 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:01:25,731 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0001_000001 (auth:SIMPLE) 2023-09-26 04:01:26,586 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0002_000001 (auth:SIMPLE) 2023-09-26 04:01:27,387 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 04:01:30,191 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0002_000001 (auth:SIMPLE) 2023-09-26 04:01:32,425 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0002_000001 (auth:SIMPLE) 2023-09-26 04:01:34,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0002_000001 (auth:SIMPLE) 2023-09-26 04:01:36,435 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 04:01:36,436 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 04:01:36,443 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-26 04:01:36,443 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 04:01:36,443 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 04:01:36,443 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-26 04:01:36,444 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-26 04:01:36,444 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-26 04:01:36,444 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-26 04:01:36,444 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-26 04:01:36,444 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700883809/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-26 04:01:36,452 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-26 04:01:36,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-09-26 04:01:36,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-26 04:01:36,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-26 04:01:36,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700896457"}]},"ts":"1695700896457"} 2023-09-26 04:01:36,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-26 04:01:36,470 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-26 04:01:36,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8174ae4a59dfaaf4e5c97545fb00d55a, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=030c3ad284a6d80318feb810686f5e98, UNASSIGN}] 2023-09-26 04:01:36,474 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8174ae4a59dfaaf4e5c97545fb00d55a, UNASSIGN 2023-09-26 04:01:36,474 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=030c3ad284a6d80318feb810686f5e98, UNASSIGN 2023-09-26 04:01:36,476 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8174ae4a59dfaaf4e5c97545fb00d55a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:36,476 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=030c3ad284a6d80318feb810686f5e98, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:36,476 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700896476"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700896476"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700896476"}]},"ts":"1695700896476"} 2023-09-26 04:01:36,476 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700896476"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700896476"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700896476"}]},"ts":"1695700896476"} 2023-09-26 04:01:36,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 8174ae4a59dfaaf4e5c97545fb00d55a, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:01:36,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 030c3ad284a6d80318feb810686f5e98, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:01:36,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-26 04:01:36,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:36,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8174ae4a59dfaaf4e5c97545fb00d55a, disabling compactions & flushes 2023-09-26 04:01:36,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:36,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:36,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. after waiting 0 ms 2023-09-26 04:01:36,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:36,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:36,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 030c3ad284a6d80318feb810686f5e98, disabling compactions & flushes 2023-09-26 04:01:36,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:36,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:36,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. after waiting 0 ms 2023-09-26 04:01:36,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:36,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:01:36,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:01:36,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:01:36,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:01:36,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a. 2023-09-26 04:01:36,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98. 2023-09-26 04:01:36,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8174ae4a59dfaaf4e5c97545fb00d55a: 2023-09-26 04:01:36,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 030c3ad284a6d80318feb810686f5e98: 2023-09-26 04:01:36,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:36,649 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8174ae4a59dfaaf4e5c97545fb00d55a, regionState=CLOSED 2023-09-26 04:01:36,650 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700896649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700896649"}]},"ts":"1695700896649"} 2023-09-26 04:01:36,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:36,650 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=030c3ad284a6d80318feb810686f5e98, regionState=CLOSED 2023-09-26 04:01:36,650 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695700896650"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700896650"}]},"ts":"1695700896650"} 2023-09-26 04:01:36,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-26 04:01:36,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 8174ae4a59dfaaf4e5c97545fb00d55a, server=jenkins-hbase20.apache.org,43719,1695700858548 in 173 msec 2023-09-26 04:01:36,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-26 04:01:36,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 030c3ad284a6d80318feb810686f5e98, server=jenkins-hbase20.apache.org,34445,1695700858593 in 172 msec 2023-09-26 04:01:36,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8174ae4a59dfaaf4e5c97545fb00d55a, UNASSIGN in 183 msec 2023-09-26 04:01:36,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-26 04:01:36,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=030c3ad284a6d80318feb810686f5e98, UNASSIGN in 184 msec 2023-09-26 04:01:36,658 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700896658"}]},"ts":"1695700896658"} 2023-09-26 04:01:36,660 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-26 04:01:36,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-26 04:01:36,783 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-26 04:01:36,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 332 msec 2023-09-26 04:01:37,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-26 04:01:37,065 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-26 04:01:37,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-09-26 04:01:37,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 04:01:37,075 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 04:01:37,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-26 04:01:37,075 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 04:01:37,076 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-26 04:01:37,080 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:37,080 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:37,082 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/recovered.edits] 2023-09-26 04:01:37,082 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/recovered.edits] 2023-09-26 04:01:37,086 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/cf/293b67218cae4c3da7ec1d1f002bdb6b to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/cf/293b67218cae4c3da7ec1d1f002bdb6b 2023-09-26 04:01:37,086 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/cf/371ef47b168e4da791ba83ab27ae078b to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/cf/371ef47b168e4da791ba83ab27ae078b 2023-09-26 04:01:37,089 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a/recovered.edits/9.seqid 2023-09-26 04:01:37,089 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98/recovered.edits/9.seqid 2023-09-26 04:01:37,090 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/030c3ad284a6d80318feb810686f5e98 2023-09-26 04:01:37,090 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemState/8174ae4a59dfaaf4e5c97545fb00d55a 2023-09-26 04:01:37,090 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-26 04:01:37,090 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-26 04:01:37,091 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-26 04:01:37,095 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926c0f3fe798e8c44efb4285618fc73be7c to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230926c0f3fe798e8c44efb4285618fc73be7c 2023-09-26 04:01:37,097 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309262869e475d0994d44aa7490a79b28b5dd to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309262869e475d0994d44aa7490a79b28b5dd 2023-09-26 04:01:37,097 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-26 04:01:37,100 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 04:01:37,102 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-26 04:01:37,104 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-26 04:01:37,106 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 04:01:37,106 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-26 04:01:37,106 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700897106"}]},"ts":"9223372036854775807"} 2023-09-26 04:01:37,106 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700897106"}]},"ts":"9223372036854775807"} 2023-09-26 04:01:37,108 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 04:01:37,108 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8174ae4a59dfaaf4e5c97545fb00d55a, NAME => 'testtb-testExportFileSystemState,,1695700882136.8174ae4a59dfaaf4e5c97545fb00d55a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 030c3ad284a6d80318feb810686f5e98, NAME => 'testtb-testExportFileSystemState,1,1695700882136.030c3ad284a6d80318feb810686f5e98.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 04:01:37,109 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-26 04:01:37,109 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695700897109"}]},"ts":"9223372036854775807"} 2023-09-26 04:01:37,111 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-26 04:01:37,122 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 04:01:37,122 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 04:01:37,122 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 04:01:37,122 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 04:01:37,122 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-26 04:01:37,122 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-26 04:01:37,122 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-26 04:01:37,122 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-26 04:01:37,122 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-26 04:01:37,123 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 04:01:37,123 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 04:01:37,123 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 04:01:37,123 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:37,123 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:37,123 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-26 04:01:37,123 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:37,123 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:37,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-26 04:01:37,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 55 msec 2023-09-26 04:01:37,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-26 04:01:37,226 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-26 04:01:37,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-26 04:01:37,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-26 04:01:37,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-09-26 04:01:37,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-26 04:01:37,270 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=767 (was 753) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:40676 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1542791596) connection to jenkins-hbase20.apache.org/148.251.75.209:35391 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_106650971_1 at /127.0.0.1:51148 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:60234 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:51182 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2076 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_106650971_1 at /127.0.0.1:40648 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 932) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 198), ProcessCount=166 (was 166), AvailableMemoryMB=7721 (was 7795) 2023-09-26 04:01:37,270 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-26 04:01:37,292 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=176, ProcessCount=166, AvailableMemoryMB=7719 2023-09-26 04:01:37,292 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-26 04:01:37,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 04:01:37,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-26 04:01:37,299 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 04:01:37,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-26 04:01:37,300 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 04:01:37,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-26 04:01:37,303 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:01:37,303 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:01:37,304 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3 empty. 2023-09-26 04:01:37,304 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54 empty. 2023-09-26 04:01:37,304 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:01:37,305 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:01:37,305 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-26 04:01:37,316 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-26 04:01:37,318 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 02cf88a7e2a77eda3604a3356bae9c54, NAME => 'testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:01:37,318 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6734df7b4bbb14d6f66f6b083dbec6d3, NAME => 'testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:01:37,338 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:37,338 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 6734df7b4bbb14d6f66f6b083dbec6d3, disabling compactions & flushes 2023-09-26 04:01:37,338 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:37,338 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:37,338 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. after waiting 0 ms 2023-09-26 04:01:37,338 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:37,338 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:37,338 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 6734df7b4bbb14d6f66f6b083dbec6d3: 2023-09-26 04:01:37,339 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:37,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 02cf88a7e2a77eda3604a3356bae9c54, disabling compactions & flushes 2023-09-26 04:01:37,340 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:37,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:37,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. after waiting 0 ms 2023-09-26 04:01:37,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:37,340 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:37,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 02cf88a7e2a77eda3604a3356bae9c54: 2023-09-26 04:01:37,342 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 04:01:37,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700897343"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700897343"}]},"ts":"1695700897343"} 2023-09-26 04:01:37,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700897343"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700897343"}]},"ts":"1695700897343"} 2023-09-26 04:01:37,346 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 04:01:37,347 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 04:01:37,348 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700897348"}]},"ts":"1695700897348"} 2023-09-26 04:01:37,349 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-26 04:01:37,352 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:01:37,353 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:01:37,353 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:01:37,353 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:01:37,353 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:01:37,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02cf88a7e2a77eda3604a3356bae9c54, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6734df7b4bbb14d6f66f6b083dbec6d3, ASSIGN}] 2023-09-26 04:01:37,356 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02cf88a7e2a77eda3604a3356bae9c54, ASSIGN 2023-09-26 04:01:37,356 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6734df7b4bbb14d6f66f6b083dbec6d3, ASSIGN 2023-09-26 04:01:37,357 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6734df7b4bbb14d6f66f6b083dbec6d3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34445,1695700858593; forceNewPlan=false, retain=false 2023-09-26 04:01:37,357 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02cf88a7e2a77eda3604a3356bae9c54, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43719,1695700858548; forceNewPlan=false, retain=false 2023-09-26 04:01:37,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-26 04:01:37,508 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 04:01:37,512 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=02cf88a7e2a77eda3604a3356bae9c54, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:37,512 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=6734df7b4bbb14d6f66f6b083dbec6d3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:37,513 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700897512"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700897512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700897512"}]},"ts":"1695700897512"} 2023-09-26 04:01:37,513 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700897512"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700897512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700897512"}]},"ts":"1695700897512"} 2023-09-26 04:01:37,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 02cf88a7e2a77eda3604a3356bae9c54, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:01:37,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 6734df7b4bbb14d6f66f6b083dbec6d3, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:01:37,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-26 04:01:37,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:37,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:37,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6734df7b4bbb14d6f66f6b083dbec6d3, NAME => 'testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 04:01:37,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02cf88a7e2a77eda3604a3356bae9c54, NAME => 'testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 04:01:37,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. service=AccessControlService 2023-09-26 04:01:37,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. service=AccessControlService 2023-09-26 04:01:37,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:01:37,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:01:37,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:01:37,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:01:37,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:37,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:01:37,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:01:37,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:01:37,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:01:37,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:01:37,681 INFO [StoreOpener-6734df7b4bbb14d6f66f6b083dbec6d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:01:37,681 INFO [StoreOpener-02cf88a7e2a77eda3604a3356bae9c54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:01:37,682 DEBUG [StoreOpener-02cf88a7e2a77eda3604a3356bae9c54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/cf 2023-09-26 04:01:37,682 DEBUG [StoreOpener-02cf88a7e2a77eda3604a3356bae9c54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/cf 2023-09-26 04:01:37,682 DEBUG [StoreOpener-6734df7b4bbb14d6f66f6b083dbec6d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/cf 2023-09-26 04:01:37,683 DEBUG [StoreOpener-6734df7b4bbb14d6f66f6b083dbec6d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/cf 2023-09-26 04:01:37,683 INFO [StoreOpener-02cf88a7e2a77eda3604a3356bae9c54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02cf88a7e2a77eda3604a3356bae9c54 columnFamilyName cf 2023-09-26 04:01:37,683 INFO [StoreOpener-6734df7b4bbb14d6f66f6b083dbec6d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6734df7b4bbb14d6f66f6b083dbec6d3 columnFamilyName cf 2023-09-26 04:01:37,684 INFO [StoreOpener-6734df7b4bbb14d6f66f6b083dbec6d3-1] regionserver.HStore(310): Store=6734df7b4bbb14d6f66f6b083dbec6d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:37,684 INFO [StoreOpener-02cf88a7e2a77eda3604a3356bae9c54-1] regionserver.HStore(310): Store=02cf88a7e2a77eda3604a3356bae9c54/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:01:37,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:01:37,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:01:37,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:01:37,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:01:37,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:01:37,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:01:37,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:01:37,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:01:37,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6734df7b4bbb14d6f66f6b083dbec6d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60454261, jitterRate=-0.0991613119840622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:01:37,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 02cf88a7e2a77eda3604a3356bae9c54; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69487819, jitterRate=0.03544919192790985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:01:37,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6734df7b4bbb14d6f66f6b083dbec6d3: 2023-09-26 04:01:37,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 02cf88a7e2a77eda3604a3356bae9c54: 2023-09-26 04:01:37,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3., pid=46, masterSystemTime=1695700897673 2023-09-26 04:01:37,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54., pid=45, masterSystemTime=1695700897671 2023-09-26 04:01:37,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:37,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:37,694 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=02cf88a7e2a77eda3604a3356bae9c54, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:37,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:37,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:37,694 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700897694"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700897694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700897694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700897694"}]},"ts":"1695700897694"} 2023-09-26 04:01:37,695 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=6734df7b4bbb14d6f66f6b083dbec6d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:37,695 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700897694"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700897694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700897694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700897694"}]},"ts":"1695700897694"} 2023-09-26 04:01:37,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-26 04:01:37,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 02cf88a7e2a77eda3604a3356bae9c54, server=jenkins-hbase20.apache.org,43719,1695700858548 in 179 msec 2023-09-26 04:01:37,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-26 04:01:37,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 6734df7b4bbb14d6f66f6b083dbec6d3, server=jenkins-hbase20.apache.org,34445,1695700858593 in 177 msec 2023-09-26 04:01:37,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02cf88a7e2a77eda3604a3356bae9c54, ASSIGN in 345 msec 2023-09-26 04:01:37,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-26 04:01:37,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6734df7b4bbb14d6f66f6b083dbec6d3, ASSIGN in 346 msec 2023-09-26 04:01:37,701 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 04:01:37,701 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700897701"}]},"ts":"1695700897701"} 2023-09-26 04:01:37,703 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-26 04:01:37,705 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 04:01:37,705 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-26 04:01:37,707 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-26 04:01:37,708 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:37,708 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:37,708 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:37,708 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:01:37,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:37,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:37,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:37,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-26 04:01:37,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 414 msec 2023-09-26 04:01:37,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-26 04:01:37,906 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-26 04:01:37,912 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-26 04:01:37,912 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:37,915 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:01:37,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 04:01:37,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700897932 (current time:1695700897932). 2023-09-26 04:01:37,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:01:37,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x0c46f13b to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:37,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1601d5d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:37,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:37,943 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:37,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c46f13b to 127.0.0.1:55155 2023-09-26 04:01:37,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:37,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x58bde786 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:37,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63490a83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:37,961 DEBUG [hconnection-0x7b7ed442-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:37,964 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:37,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:37,970 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:37,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58bde786 to 127.0.0.1:55155 2023-09-26 04:01:37,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:37,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-26 04:01:37,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:01:37,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 04:01:37,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 04:01:37,976 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 04:01:37,977 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695701497977 2023-09-26 04:01:37,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-26 04:01:37,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 04:01:37,979 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:01:37,979 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:01:37,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 04:01:37,981 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 04:01:37,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-26 04:01:37,983 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 04:01:37,984 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695701497984 2023-09-26 04:01:37,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:37,996 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-26 04:01:37,996 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:37,998 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-26 04:01:37,998 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-26 04:01:37,998 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:37,998 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:37,999 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:37,999 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:37,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:37,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:37,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:37,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:37,999 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:37,999 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,000 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,000 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,000 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,000 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 04:01:38,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 04:01:38,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-26 04:01:38,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,001 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 04:01:38,001 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 04:01:38,001 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:38,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 04:01:38,001 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:38,002 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 04:01:38,002 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-26 04:01:38,003 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 04:01:38,003 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-26 04:01:38,003 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-26 04:01:38,003 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-26 04:01:38,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,003 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 04:01:38,003 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:38,006 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 04:01:38,006 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-26 04:01:38,006 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-26 04:01:38,014 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,014 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,016 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,016 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,018 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,018 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-26 04:01:38,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d2e7cb5[Count = 1] remaining members to acquire global barrier 2023-09-26 04:01:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-26 04:01:38,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d2e7cb5[Count = 0] remaining members to acquire global barrier 2023-09-26 04:01:38,021 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-26 04:01:38,021 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,024 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,024 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,024 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,024 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 04:01:38,024 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-26 04:01:38,024 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:01:38,024 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,024 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 04:01:38,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,025 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 04:01:38,025 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:38,025 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,025 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:01:38,025 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:38,025 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:38,025 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:38,025 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. started... 2023-09-26 04:01:38,025 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. started... 2023-09-26 04:01:38,025 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:38,025 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:38,027 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6734df7b4bbb14d6f66f6b083dbec6d3: 2023-09-26 04:01:38,025 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02cf88a7e2a77eda3604a3356bae9c54: 2023-09-26 04:01:38,027 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 04:01:38,027 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:38,027 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,027 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,027 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-26 04:01:38,028 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:38,028 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:38,029 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:01:38,029 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:01:38,041 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. completed. 2023-09-26 04:01:38,041 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:38,041 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. completed. 2023-09-26 04:01:38,041 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:38,041 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:38,041 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:38,041 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:38,041 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,041 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:38,041 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-26 04:01:38,041 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,042 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:01:38,042 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-26 04:01:38,042 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:01:38,043 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 04:01:38,043 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:38,043 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,043 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 04:01:38,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,044 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:38,044 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-26 04:01:38,044 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,043 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-26 04:01:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:01:38,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-26 04:01:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,43719,1695700858548': 2023-09-26 04:01:38,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-26 04:01:38,053 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-26 04:01:38,053 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:01:38,053 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:01:38,053 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,053 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:01:38,064 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,064 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,064 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,064 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,064 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,064 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,064 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,065 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,066 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,066 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,069 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,069 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,069 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,075 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,075 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,075 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,075 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,075 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,076 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,075 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,075 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,076 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,076 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,076 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-26 04:01:38,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,078 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,078 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:01:38,078 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,079 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,079 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,079 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,079 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,079 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:38,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 04:01:38,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-26 04:01:38,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:01:38,081 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:01:38,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-26 04:01:38,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,109 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-26 04:01:38,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695700897977Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695700898089 (+112 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695700898089Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695700898089Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695700898094 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695700898103 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695700898109 (+6 ms) 2023-09-26 04:01:38,113 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 04:01:38,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 135 msec 2023-09-26 04:01:38,281 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:38,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-26 04:01:38,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:01:38,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:01:38,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34445] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:01:38,296 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-26 04:01:38,296 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:38,296 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:01:38,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 04:01:38,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700898308 (current time:1695700898308). 2023-09-26 04:01:38,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:01:38,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x09eb5fc7 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:38,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c2b614d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:38,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:38,326 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:38,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09eb5fc7 to 127.0.0.1:55155 2023-09-26 04:01:38,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:38,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x59efab02 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:01:38,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@aa9c29f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:01:38,344 DEBUG [hconnection-0xd8ffb8e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:38,345 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:38,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:01:38,351 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:01:38,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59efab02 to 127.0.0.1:55155 2023-09-26 04:01:38,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:01:38,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-26 04:01:38,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:01:38,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 04:01:38,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 04:01:38,357 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 04:01:38,358 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695701498358 2023-09-26 04:01:38,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-26 04:01:38,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-26 04:01:38,360 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:01:38,360 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:01:38,362 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-26 04:01:38,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 04:01:38,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-26 04:01:38,365 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 04:01:38,366 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695701498366 2023-09-26 04:01:38,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-26 04:01:38,381 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-26 04:01:38,381 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:38,383 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-26 04:01:38,383 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-26 04:01:38,383 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,383 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,384 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,384 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,385 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,385 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,385 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-26 04:01:38,386 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,386 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:01:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-26 04:01:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,386 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 04:01:38,386 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 04:01:38,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-26 04:01:38,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-26 04:01:38,387 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 04:01:38,387 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:38,388 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 04:01:38,388 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-26 04:01:38,388 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 04:01:38,388 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-26 04:01:38,388 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,388 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,392 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 04:01:38,392 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-26 04:01:38,392 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-26 04:01:38,397 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,400 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,400 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-26 04:01:38,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,400 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,400 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:38,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,400 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-26 04:01:38,400 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,400 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:38,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-26 04:01:38,401 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-26 04:01:38,401 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:01:38,402 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-26 04:01:38,402 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-26 04:01:38,402 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-26 04:01:38,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 04:01:38,403 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,403 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,403 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,403 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:01:38,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-26 04:01:38,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@326a6a8b[Count = 1] remaining members to acquire global barrier 2023-09-26 04:01:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 04:01:38,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-26 04:01:38,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@326a6a8b[Count = 0] remaining members to acquire global barrier 2023-09-26 04:01:38,406 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-26 04:01:38,406 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,406 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,406 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,406 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,407 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,407 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 04:01:38,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,407 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 04:01:38,407 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:38,407 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,407 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:01:38,407 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:38,407 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-26 04:01:38,407 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-26 04:01:38,407 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:38,407 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:01:38,407 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. started... 2023-09-26 04:01:38,407 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:38,407 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:01:38,407 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. started... 2023-09-26 04:01:38,407 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:01:38,408 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 02cf88a7e2a77eda3604a3356bae9c54 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-26 04:01:38,408 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6734df7b4bbb14d6f66f6b083dbec6d3 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-26 04:01:38,409 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 04:01:38,409 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:38,409 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-26 04:01:38,442 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309263b825c045c29462cbb41f6da91dcafde to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309263b825c045c29462cbb41f6da91dcafde 2023-09-26 04:01:38,445 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092688e00ba39dfc49648ef4c6e2b29b80a5 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092688e00ba39dfc49648ef4c6e2b29b80a5 2023-09-26 04:01:38,458 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/.tmp/cf/2f615f2f27c54cf19f15659fa3dec0e5 2023-09-26 04:01:38,461 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:38,461 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/.tmp/cf/1c3adb8216cc4841b98b3fe70c1249c0 2023-09-26 04:01:38,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-26 04:01:38,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:01:38,462 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:01:38,464 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/.tmp/cf/2f615f2f27c54cf19f15659fa3dec0e5 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/cf/2f615f2f27c54cf19f15659fa3dec0e5 2023-09-26 04:01:38,467 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/.tmp/cf/1c3adb8216cc4841b98b3fe70c1249c0 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/cf/1c3adb8216cc4841b98b3fe70c1249c0 2023-09-26 04:01:38,470 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/cf/2f615f2f27c54cf19f15659fa3dec0e5, entries=4, sequenceid=6, filesize=5.6 K 2023-09-26 04:01:38,471 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 02cf88a7e2a77eda3604a3356bae9c54 in 63ms, sequenceid=6, compaction requested=false 2023-09-26 04:01:38,471 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-26 04:01:38,472 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02cf88a7e2a77eda3604a3356bae9c54: 2023-09-26 04:01:38,472 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-26 04:01:38,472 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:38,472 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/cf/2f615f2f27c54cf19f15659fa3dec0e5] hfiles 2023-09-26 04:01:38,472 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/cf/2f615f2f27c54cf19f15659fa3dec0e5 for snapshot=snaptb0-testConsecutiveExports 2023-09-26 04:01:38,473 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/cf/1c3adb8216cc4841b98b3fe70c1249c0, entries=46, sequenceid=6, filesize=12.5 K 2023-09-26 04:01:38,474 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6734df7b4bbb14d6f66f6b083dbec6d3 in 67ms, sequenceid=6, compaction requested=false 2023-09-26 04:01:38,476 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6734df7b4bbb14d6f66f6b083dbec6d3: 2023-09-26 04:01:38,476 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-26 04:01:38,476 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:01:38,476 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/cf/1c3adb8216cc4841b98b3fe70c1249c0] hfiles 2023-09-26 04:01:38,476 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/cf/1c3adb8216cc4841b98b3fe70c1249c0 for snapshot=snaptb0-testConsecutiveExports 2023-09-26 04:01:38,490 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. completed. 2023-09-26 04:01:38,490 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:01:38,490 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:38,491 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:38,491 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,492 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-26 04:01:38,492 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:01:38,493 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,494 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 04:01:38,494 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:38,494 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-26 04:01:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,496 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. completed. 2023-09-26 04:01:38,496 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:01:38,496 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:01:38,496 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:01:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 04:01:38,496 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,496 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-26 04:01:38,496 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:01:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,497 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,497 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-26 04:01:38,497 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:38,497 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-26 04:01:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 04:01:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,43719,1695700858548': 2023-09-26 04:01:38,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-26 04:01:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 04:01:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 04:01:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:01:38,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-26 04:01:38,504 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-26 04:01:38,504 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:01:38,504 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:01:38,504 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-26 04:01:38,504 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:01:38,506 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:01:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:01:38,506 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,506 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:01:38,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,506 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 04:01:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,507 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:01:38,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,507 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 04:01:38,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:01:38,510 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-26 04:01:38,511 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,511 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,518 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,518 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,518 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:01:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-26 04:01:38,518 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,518 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,518 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-26 04:01:38,518 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:01:38,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:01:38,518 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:01:38,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:01:38,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-26 04:01:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,519 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:01:38,520 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,520 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,520 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,521 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:01:38,521 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,521 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:01:38,521 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:01:38,521 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,521 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:01:38,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:01:38,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092688e00ba39dfc49648ef4c6e2b29b80a5, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309263b825c045c29462cbb41f6da91dcafde] mob files 2023-09-26 04:01:38,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092688e00ba39dfc49648ef4c6e2b29b80a5 2023-09-26 04:01:38,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309263b825c045c29462cbb41f6da91dcafde 2023-09-26 04:01:38,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-26 04:01:38,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-26 04:01:38,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,550 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695700898358Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695700898528 (+170 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695700898528Loading Region manifests for snaptb0-testConsecutiveExports at 1695700898528Writing data manifest for snaptb0-testConsecutiveExports at 1695700898535 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695700898543 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695700898550 (+7 ms) 2023-09-26 04:01:38,552 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-26 04:01:38,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 193 msec 2023-09-26 04:01:38,662 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:01:38,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-26 04:01:38,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:01:38,665 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665 2023-09-26 04:01:38,665 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665, srcFsUri=hdfs://localhost:36857, srcDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:01:38,691 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:01:38,691 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7ffbff8d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,691 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa, snapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-26 04:01:38,699 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 04:01:38,715 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:38,716 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:38,716 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:38,717 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:39,463 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-6690140147229885239.jar 2023-09-26 04:01:39,464 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:39,464 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:39,517 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-1339104291866095504.jar 2023-09-26 04:01:39,517 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:39,518 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:39,518 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:39,518 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:39,519 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:39,519 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:39,519 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 04:01:39,520 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 04:01:39,520 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 04:01:39,520 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 04:01:39,520 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 04:01:39,521 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 04:01:39,521 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 04:01:39,521 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 04:01:39,522 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 04:01:39,522 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 04:01:39,522 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:39,523 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:39,523 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:39,523 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:39,524 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:39,524 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:39,524 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:39,869 WARN [Listener at jenkins-hbase20.apache.org/39825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 04:01:39,871 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-26 04:01:39,873 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-26 04:01:40,873 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:01:40,873 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:01:40,876 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0002_000001 (auth:SIMPLE) 2023-09-26 04:01:41,736 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0003_000001 (auth:SIMPLE) 2023-09-26 04:01:42,217 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 04:01:45,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0003_000001 (auth:SIMPLE) 2023-09-26 04:01:47,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0003_000001 (auth:SIMPLE) 2023-09-26 04:01:49,254 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0003_000001 (auth:SIMPLE) 2023-09-26 04:01:51,066 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 04:01:51,066 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 04:01:51,070 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-26 04:01:51,070 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 04:01:51,071 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 04:01:51,071 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 04:01:51,073 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-26 04:01:51,073 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-26 04:01:51,073 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@68e2875 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 04:01:51,073 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-26 04:01:51,073 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-26 04:01:51,074 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665, srcFsUri=hdfs://localhost:36857, srcDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:01:51,092 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:01:51,093 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@18425999, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 04:01:51,093 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa, snapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-26 04:01:51,103 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-26 04:01:51,114 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,114 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,115 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,115 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,818 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-4360020031320056929.jar 2023-09-26 04:01:51,819 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,819 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,873 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-5275949217190895215.jar 2023-09-26 04:01:51,873 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,874 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,874 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,874 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,875 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,875 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 04:01:51,875 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 04:01:51,876 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 04:01:51,876 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 04:01:51,876 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 04:01:51,876 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 04:01:51,877 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 04:01:51,877 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 04:01:51,877 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 04:01:51,878 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 04:01:51,878 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 04:01:51,878 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:51,879 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:51,879 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:51,879 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:51,880 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:01:51,880 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:51,880 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:01:52,225 WARN [Listener at jenkins-hbase20.apache.org/39825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 04:01:52,227 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-26 04:01:52,229 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-26 04:01:55,438 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:01:55,439 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:01:55,442 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0003_000001 (auth:SIMPLE) 2023-09-26 04:01:55,891 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0004_000001 (auth:SIMPLE) 2023-09-26 04:01:59,296 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0004_000001 (auth:SIMPLE) 2023-09-26 04:02:01,500 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0004_000001 (auth:SIMPLE) 2023-09-26 04:02:04,023 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0004_000001 (auth:SIMPLE) 2023-09-26 04:02:05,504 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 04:02:05,505 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 04:02:05,508 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-26 04:02:05,509 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 04:02:05,509 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 04:02:05,509 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 04:02:05,509 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-26 04:02:05,510 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-26 04:02:05,510 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@68e2875 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-26 04:02:05,510 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-26 04:02:05,510 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/local-export-1695700898665/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-26 04:02:05,521 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-26 04:02:05,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-09-26 04:02:05,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-26 04:02:05,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-26 04:02:05,526 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700925526"}]},"ts":"1695700925526"} 2023-09-26 04:02:05,527 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-26 04:02:05,528 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-26 04:02:05,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02cf88a7e2a77eda3604a3356bae9c54, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6734df7b4bbb14d6f66f6b083dbec6d3, UNASSIGN}] 2023-09-26 04:02:05,531 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6734df7b4bbb14d6f66f6b083dbec6d3, UNASSIGN 2023-09-26 04:02:05,531 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02cf88a7e2a77eda3604a3356bae9c54, UNASSIGN 2023-09-26 04:02:05,532 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=6734df7b4bbb14d6f66f6b083dbec6d3, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:05,532 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=02cf88a7e2a77eda3604a3356bae9c54, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:05,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700925532"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700925532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700925532"}]},"ts":"1695700925532"} 2023-09-26 04:02:05,532 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700925532"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700925532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700925532"}]},"ts":"1695700925532"} 2023-09-26 04:02:05,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 02cf88a7e2a77eda3604a3356bae9c54, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:02:05,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 6734df7b4bbb14d6f66f6b083dbec6d3, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:02:05,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-26 04:02:05,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:02:05,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:02:05,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 02cf88a7e2a77eda3604a3356bae9c54, disabling compactions & flushes 2023-09-26 04:02:05,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6734df7b4bbb14d6f66f6b083dbec6d3, disabling compactions & flushes 2023-09-26 04:02:05,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:02:05,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:02:05,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:02:05,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:02:05,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. after waiting 0 ms 2023-09-26 04:02:05,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. after waiting 0 ms 2023-09-26 04:02:05,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:02:05,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:02:05,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:02:05,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:02:05,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:05,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:05,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54. 2023-09-26 04:02:05,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3. 2023-09-26 04:02:05,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6734df7b4bbb14d6f66f6b083dbec6d3: 2023-09-26 04:02:05,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 02cf88a7e2a77eda3604a3356bae9c54: 2023-09-26 04:02:05,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:02:05,721 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=6734df7b4bbb14d6f66f6b083dbec6d3, regionState=CLOSED 2023-09-26 04:02:05,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:02:05,721 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700925721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700925721"}]},"ts":"1695700925721"} 2023-09-26 04:02:05,722 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=02cf88a7e2a77eda3604a3356bae9c54, regionState=CLOSED 2023-09-26 04:02:05,722 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695700925721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700925721"}]},"ts":"1695700925721"} 2023-09-26 04:02:05,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-26 04:02:05,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 6734df7b4bbb14d6f66f6b083dbec6d3, server=jenkins-hbase20.apache.org,34445,1695700858593 in 188 msec 2023-09-26 04:02:05,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-26 04:02:05,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 02cf88a7e2a77eda3604a3356bae9c54, server=jenkins-hbase20.apache.org,43719,1695700858548 in 190 msec 2023-09-26 04:02:05,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6734df7b4bbb14d6f66f6b083dbec6d3, UNASSIGN in 195 msec 2023-09-26 04:02:05,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-26 04:02:05,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02cf88a7e2a77eda3604a3356bae9c54, UNASSIGN in 197 msec 2023-09-26 04:02:05,729 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700925729"}]},"ts":"1695700925729"} 2023-09-26 04:02:05,730 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-26 04:02:05,757 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-26 04:02:05,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 236 msec 2023-09-26 04:02:05,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-26 04:02:05,829 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-26 04:02:05,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-09-26 04:02:05,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 04:02:05,837 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 04:02:05,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-26 04:02:05,838 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 04:02:05,842 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-26 04:02:05,846 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 04:02:05,846 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 04:02:05,846 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 04:02:05,846 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 04:02:05,846 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-26 04:02:05,846 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-26 04:02:05,846 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-26 04:02:05,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-26 04:02:05,847 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 04:02:05,847 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 04:02:05,847 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:05,847 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:05,847 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 04:02:05,847 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-26 04:02:05,847 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:05,847 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:05,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-26 04:02:05,848 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:02:05,848 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:02:05,852 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/recovered.edits] 2023-09-26 04:02:05,852 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/recovered.edits] 2023-09-26 04:02:05,857 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/cf/1c3adb8216cc4841b98b3fe70c1249c0 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/cf/1c3adb8216cc4841b98b3fe70c1249c0 2023-09-26 04:02:05,857 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/cf/2f615f2f27c54cf19f15659fa3dec0e5 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/cf/2f615f2f27c54cf19f15659fa3dec0e5 2023-09-26 04:02:05,860 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3/recovered.edits/9.seqid 2023-09-26 04:02:05,860 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54/recovered.edits/9.seqid 2023-09-26 04:02:05,860 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/6734df7b4bbb14d6f66f6b083dbec6d3 2023-09-26 04:02:05,861 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testConsecutiveExports/02cf88a7e2a77eda3604a3356bae9c54 2023-09-26 04:02:05,861 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-26 04:02:05,861 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-26 04:02:05,862 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-26 04:02:05,866 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092688e00ba39dfc49648ef4c6e2b29b80a5 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092688e00ba39dfc49648ef4c6e2b29b80a5 2023-09-26 04:02:05,867 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309263b825c045c29462cbb41f6da91dcafde to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309263b825c045c29462cbb41f6da91dcafde 2023-09-26 04:02:05,868 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-26 04:02:05,871 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 04:02:05,873 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-26 04:02:05,876 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-26 04:02:05,877 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 04:02:05,877 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-26 04:02:05,877 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700925877"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:05,878 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700925877"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:05,880 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 04:02:05,880 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 02cf88a7e2a77eda3604a3356bae9c54, NAME => 'testtb-testConsecutiveExports,,1695700897294.02cf88a7e2a77eda3604a3356bae9c54.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6734df7b4bbb14d6f66f6b083dbec6d3, NAME => 'testtb-testConsecutiveExports,1,1695700897294.6734df7b4bbb14d6f66f6b083dbec6d3.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 04:02:05,880 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-26 04:02:05,880 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695700925880"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:05,881 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-26 04:02:05,883 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-26 04:02:05,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 52 msec 2023-09-26 04:02:05,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-26 04:02:05,951 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-26 04:02:05,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-26 04:02:05,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-26 04:02:05,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-09-26 04:02:05,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-26 04:02:06,000 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=758 (was 767), OpenFileDescriptor=922 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=139 (was 176), ProcessCount=166 (was 166), AvailableMemoryMB=7483 (was 7719) 2023-09-26 04:02:06,001 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-26 04:02:06,022 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=139, ProcessCount=166, AvailableMemoryMB=7482 2023-09-26 04:02:06,022 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-26 04:02:06,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 04:02:06,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,027 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 04:02:06,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-26 04:02:06,028 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 04:02:06,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-26 04:02:06,030 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:06,030 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:06,031 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af empty. 2023-09-26 04:02:06,031 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e empty. 2023-09-26 04:02:06,031 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:06,031 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:06,031 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-26 04:02:06,043 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-26 04:02:06,045 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => ca4497896fd8f0de7912db04677ed8af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:02:06,045 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 17c30abaaeef21aaf7ff010a7501e70e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:02:06,058 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:06,058 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 17c30abaaeef21aaf7ff010a7501e70e, disabling compactions & flushes 2023-09-26 04:02:06,058 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,058 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,058 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. after waiting 0 ms 2023-09-26 04:02:06,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:06,059 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing ca4497896fd8f0de7912db04677ed8af, disabling compactions & flushes 2023-09-26 04:02:06,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 17c30abaaeef21aaf7ff010a7501e70e: 2023-09-26 04:02:06,059 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:06,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:06,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. after waiting 0 ms 2023-09-26 04:02:06,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:06,059 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:06,059 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for ca4497896fd8f0de7912db04677ed8af: 2023-09-26 04:02:06,061 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 04:02:06,062 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700926062"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700926062"}]},"ts":"1695700926062"} 2023-09-26 04:02:06,062 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700926062"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700926062"}]},"ts":"1695700926062"} 2023-09-26 04:02:06,068 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 04:02:06,068 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 04:02:06,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700926068"}]},"ts":"1695700926068"} 2023-09-26 04:02:06,070 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-26 04:02:06,072 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:02:06,073 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:02:06,073 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:02:06,073 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:02:06,073 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:02:06,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17c30abaaeef21aaf7ff010a7501e70e, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca4497896fd8f0de7912db04677ed8af, ASSIGN}] 2023-09-26 04:02:06,075 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca4497896fd8f0de7912db04677ed8af, ASSIGN 2023-09-26 04:02:06,075 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17c30abaaeef21aaf7ff010a7501e70e, ASSIGN 2023-09-26 04:02:06,076 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17c30abaaeef21aaf7ff010a7501e70e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44553,1695700858629; forceNewPlan=false, retain=false 2023-09-26 04:02:06,076 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca4497896fd8f0de7912db04677ed8af, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34445,1695700858593; forceNewPlan=false, retain=false 2023-09-26 04:02:06,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-26 04:02:06,226 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 04:02:06,231 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=17c30abaaeef21aaf7ff010a7501e70e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,232 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ca4497896fd8f0de7912db04677ed8af, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,232 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700926231"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700926231"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700926231"}]},"ts":"1695700926231"} 2023-09-26 04:02:06,232 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700926231"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700926231"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700926231"}]},"ts":"1695700926231"} 2023-09-26 04:02:06,236 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 17c30abaaeef21aaf7ff010a7501e70e, server=jenkins-hbase20.apache.org,44553,1695700858629}] 2023-09-26 04:02:06,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure ca4497896fd8f0de7912db04677ed8af, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:02:06,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-26 04:02:06,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:06,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca4497896fd8f0de7912db04677ed8af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 04:02:06,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17c30abaaeef21aaf7ff010a7501e70e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 04:02:06,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. service=AccessControlService 2023-09-26 04:02:06,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. service=AccessControlService 2023-09-26 04:02:06,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:02:06,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:02:06,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:06,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:06,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:06,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:06,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:06,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:06,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:06,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:06,407 INFO [StoreOpener-ca4497896fd8f0de7912db04677ed8af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:06,407 INFO [StoreOpener-17c30abaaeef21aaf7ff010a7501e70e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:06,413 DEBUG [StoreOpener-ca4497896fd8f0de7912db04677ed8af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/cf 2023-09-26 04:02:06,413 DEBUG [StoreOpener-ca4497896fd8f0de7912db04677ed8af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/cf 2023-09-26 04:02:06,413 DEBUG [StoreOpener-17c30abaaeef21aaf7ff010a7501e70e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/cf 2023-09-26 04:02:06,413 DEBUG [StoreOpener-17c30abaaeef21aaf7ff010a7501e70e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/cf 2023-09-26 04:02:06,414 INFO [StoreOpener-17c30abaaeef21aaf7ff010a7501e70e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17c30abaaeef21aaf7ff010a7501e70e columnFamilyName cf 2023-09-26 04:02:06,414 INFO [StoreOpener-ca4497896fd8f0de7912db04677ed8af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca4497896fd8f0de7912db04677ed8af columnFamilyName cf 2023-09-26 04:02:06,416 INFO [StoreOpener-ca4497896fd8f0de7912db04677ed8af-1] regionserver.HStore(310): Store=ca4497896fd8f0de7912db04677ed8af/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:02:06,416 INFO [StoreOpener-17c30abaaeef21aaf7ff010a7501e70e-1] regionserver.HStore(310): Store=17c30abaaeef21aaf7ff010a7501e70e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:02:06,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:06,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:06,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:06,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:06,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:06,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:06,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:02:06,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:02:06,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ca4497896fd8f0de7912db04677ed8af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61368666, jitterRate=-0.08553561568260193}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:02:06,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ca4497896fd8f0de7912db04677ed8af: 2023-09-26 04:02:06,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 17c30abaaeef21aaf7ff010a7501e70e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72678121, jitterRate=0.08298839628696442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:02:06,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 17c30abaaeef21aaf7ff010a7501e70e: 2023-09-26 04:02:06,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af., pid=61, masterSystemTime=1695700926390 2023-09-26 04:02:06,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e., pid=60, masterSystemTime=1695700926389 2023-09-26 04:02:06,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:06,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:06,431 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ca4497896fd8f0de7912db04677ed8af, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,431 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700926431"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700926431"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700926431"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700926431"}]},"ts":"1695700926431"} 2023-09-26 04:02:06,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=17c30abaaeef21aaf7ff010a7501e70e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700926432"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700926432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700926432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700926432"}]},"ts":"1695700926432"} 2023-09-26 04:02:06,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-26 04:02:06,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure ca4497896fd8f0de7912db04677ed8af, server=jenkins-hbase20.apache.org,34445,1695700858593 in 196 msec 2023-09-26 04:02:06,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-26 04:02:06,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 17c30abaaeef21aaf7ff010a7501e70e, server=jenkins-hbase20.apache.org,44553,1695700858629 in 198 msec 2023-09-26 04:02:06,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca4497896fd8f0de7912db04677ed8af, ASSIGN in 362 msec 2023-09-26 04:02:06,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-26 04:02:06,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17c30abaaeef21aaf7ff010a7501e70e, ASSIGN in 362 msec 2023-09-26 04:02:06,437 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 04:02:06,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700926437"}]},"ts":"1695700926437"} 2023-09-26 04:02:06,438 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-26 04:02:06,440 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 04:02:06,440 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-26 04:02:06,442 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-26 04:02:06,443 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:06,443 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:06,443 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:06,443 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:06,444 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:06,444 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:06,444 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:06,444 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:06,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 420 msec 2023-09-26 04:02:06,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-26 04:02:06,635 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-26 04:02:06,638 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,638 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,641 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:02:06,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 04:02:06,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700926655 (current time:1695700926655). 2023-09-26 04:02:06,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:02:06,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x19ebf80e to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:06,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ad40945, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:06,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:06,665 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:06,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19ebf80e to 127.0.0.1:55155 2023-09-26 04:02:06,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:06,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x6cae0768 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:06,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ac3a97b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:06,674 DEBUG [hconnection-0x30471347-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:06,677 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:06,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:06,685 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:06,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cae0768 to 127.0.0.1:55155 2023-09-26 04:02:06,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:06,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-26 04:02:06,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:02:06,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 04:02:06,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 04:02:06,691 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 04:02:06,692 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695701526692 2023-09-26 04:02:06,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 04:02:06,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,694 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:02:06,694 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:02:06,695 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 04:02:06,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 04:02:06,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-26 04:02:06,698 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 04:02:06,699 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695701526699 2023-09-26 04:02:06,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,711 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-26 04:02:06,711 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:06,713 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-26 04:02:06,713 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-26 04:02:06,713 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,713 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,714 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:06,714 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:06,714 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:06,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:06,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:06,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:06,714 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,714 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,715 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,715 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:02:06,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-26 04:02:06,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 04:02:06,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-26 04:02:06,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,716 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 04:02:06,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,716 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 04:02:06,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,716 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:06,716 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 04:02:06,717 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:06,717 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 04:02:06,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:06,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:06,717 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 04:02:06,717 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:06,718 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 04:02:06,719 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 04:02:06,719 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 04:02:06,719 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 04:02:06,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,724 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-26 04:02:06,724 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,724 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:06,724 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 04:02:06,724 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:06,724 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,724 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:06,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,724 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 04:02:06,724 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:06,726 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 04:02:06,726 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 04:02:06,726 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 04:02:06,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:06,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:06,729 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,729 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,730 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,730 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:06,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-26 04:02:06,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c91c37f[Count = 1] remaining members to acquire global barrier 2023-09-26 04:02:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:06,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-26 04:02:06,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c91c37f[Count = 0] remaining members to acquire global barrier 2023-09-26 04:02:06,732 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-26 04:02:06,733 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,740 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,740 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,740 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 04:02:06,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,741 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 04:02:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 04:02:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:02:06,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,741 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,741 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,741 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. started... 2023-09-26 04:02:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:06,741 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:02:06,742 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17c30abaaeef21aaf7ff010a7501e70e: 2023-09-26 04:02:06,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,742 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 04:02:06,742 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,742 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:06,742 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:06,742 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:06,742 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:06,742 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:02:06,742 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. started... 2023-09-26 04:02:06,743 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca4497896fd8f0de7912db04677ed8af: 2023-09-26 04:02:06,743 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,744 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:06,744 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:02:06,747 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 04:02:06,747 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:06,747 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 04:02:06,753 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. completed. 2023-09-26 04:02:06,753 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:06,753 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. completed. 2023-09-26 04:02:06,753 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:06,753 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:06,754 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,753 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:06,754 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 04:02:06,754 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:06,754 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:06,754 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:02:06,754 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,754 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 04:02:06,754 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:02:06,757 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 04:02:06,757 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,757 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 04:02:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:06,757 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,757 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:06,757 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 04:02:06,757 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:06,759 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 04:02:06,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:06,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:06,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,44553,1695700858629': 2023-09-26 04:02:06,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-26 04:02:06,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:06,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:06,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:06,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:06,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:02:06,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-26 04:02:06,769 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-26 04:02:06,769 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:02:06,769 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:02:06,769 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,769 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:02:06,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:06,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:06,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,772 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:06,772 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:06,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:06,773 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:06,773 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,775 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:06,775 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,775 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,777 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,777 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,777 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,777 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:06,777 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:06,778 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:06,777 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,778 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:06,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:06,778 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:06,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:06,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:06,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:06,778 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:06,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,778 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:06,778 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,779 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:06,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:06,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:02:06,779 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:06,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:06,780 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:06,780 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:06,780 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:06,780 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,780 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:06,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:06,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:06,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:06,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 04:02:06,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,794 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:06,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-26 04:02:06,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:02:06,795 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:02:06,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-26 04:02:06,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,814 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:06,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695700926692Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695700926791 (+99 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695700926791Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695700926791Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695700926794 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695700926808 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695700926814 (+6 ms) 2023-09-26 04:02:06,816 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 04:02:06,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 122 msec 2023-09-26 04:02:06,995 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:06,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-26 04:02:06,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:02:07,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44553] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:02:07,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34445] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:02:07,012 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,012 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:07,012 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:02:07,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 04:02:07,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700927022 (current time:1695700927022). 2023-09-26 04:02:07,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:02:07,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x60c4a9ce to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:07,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@184b0808, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:07,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:07,032 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:07,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60c4a9ce to 127.0.0.1:55155 2023-09-26 04:02:07,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:07,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x552fa753 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:07,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@847d73f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:07,043 DEBUG [hconnection-0x59c575d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:07,046 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:07,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:07,054 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:07,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x552fa753 to 127.0.0.1:55155 2023-09-26 04:02:07,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:07,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-26 04:02:07,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:02:07,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 04:02:07,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 04:02:07,060 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 04:02:07,060 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695701527060 2023-09-26 04:02:07,061 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-26 04:02:07,062 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:02:07,062 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:02:07,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 04:02:07,063 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-26 04:02:07,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-26 04:02:07,065 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 04:02:07,066 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695701527066 2023-09-26 04:02:07,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,074 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-26 04:02:07,075 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:07,076 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-26 04:02:07,076 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-26 04:02:07,076 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,076 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,077 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:07,077 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:07,077 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:07,077 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:07,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:07,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,078 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,078 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,078 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,079 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-26 04:02:07,079 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 04:02:07,079 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,081 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 04:02:07,081 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 04:02:07,081 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 04:02:07,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,081 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 04:02:07,081 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-26 04:02:07,081 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:07,081 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:07,082 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 04:02:07,083 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 04:02:07,083 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 04:02:07,083 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-26 04:02:07,083 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-26 04:02:07,083 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-26 04:02:07,084 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,084 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:07,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:07,084 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,084 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,085 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:07,085 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,085 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,085 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:07,085 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:07,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:07,085 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,085 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:07,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:07,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-26 04:02:07,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41882358[Count = 1] remaining members to acquire global barrier 2023-09-26 04:02:07,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:07,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:07,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:07,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:07,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:07,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-26 04:02:07,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41882358[Count = 0] remaining members to acquire global barrier 2023-09-26 04:02:07,091 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-26 04:02:07,091 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,099 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,099 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,099 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,099 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 04:02:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 04:02:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:02:07,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,100 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 04:02:07,099 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-26 04:02:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:07,100 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:07,101 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,101 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:02:07,100 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:07,101 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. started... 2023-09-26 04:02:07,101 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. started... 2023-09-26 04:02:07,101 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 04:02:07,101 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:07,101 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 17c30abaaeef21aaf7ff010a7501e70e 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-26 04:02:07,101 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ca4497896fd8f0de7912db04677ed8af 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-26 04:02:07,101 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 04:02:07,125 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230926881326bb48b0433fa6f45e2aac948844 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926881326bb48b0433fa6f45e2aac948844 2023-09-26 04:02:07,125 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309262da218f15cfc443186c169c3a8bd20b6 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309262da218f15cfc443186c169c3a8bd20b6 2023-09-26 04:02:07,132 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/.tmp/cf/d8d34ae5d40242c0afdeda5755756846 2023-09-26 04:02:07,132 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/.tmp/cf/b30b411fa46b42c98e312c4feb13fda3 2023-09-26 04:02:07,137 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/.tmp/cf/d8d34ae5d40242c0afdeda5755756846 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/cf/d8d34ae5d40242c0afdeda5755756846 2023-09-26 04:02:07,138 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/.tmp/cf/b30b411fa46b42c98e312c4feb13fda3 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/cf/b30b411fa46b42c98e312c4feb13fda3 2023-09-26 04:02:07,144 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/cf/d8d34ae5d40242c0afdeda5755756846, entries=46, sequenceid=6, filesize=13.4 K 2023-09-26 04:02:07,144 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/cf/b30b411fa46b42c98e312c4feb13fda3, entries=4, sequenceid=6, filesize=5.6 K 2023-09-26 04:02:07,145 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 17c30abaaeef21aaf7ff010a7501e70e in 44ms, sequenceid=6, compaction requested=false 2023-09-26 04:02:07,145 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for ca4497896fd8f0de7912db04677ed8af in 44ms, sequenceid=6, compaction requested=false 2023-09-26 04:02:07,145 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-26 04:02:07,145 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-26 04:02:07,148 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17c30abaaeef21aaf7ff010a7501e70e: 2023-09-26 04:02:07,148 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca4497896fd8f0de7912db04677ed8af: 2023-09-26 04:02:07,148 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,149 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:07,149 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,149 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:07,149 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/cf/b30b411fa46b42c98e312c4feb13fda3] hfiles 2023-09-26 04:02:07,149 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/cf/d8d34ae5d40242c0afdeda5755756846] hfiles 2023-09-26 04:02:07,149 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/cf/d8d34ae5d40242c0afdeda5755756846 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,149 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/cf/b30b411fa46b42c98e312c4feb13fda3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,157 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. completed. 2023-09-26 04:02:07,157 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:07,157 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. completed. 2023-09-26 04:02:07,157 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:07,157 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:07,157 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:07,157 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,158 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:07,158 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:07,158 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 04:02:07,158 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,158 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:02:07,158 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-26 04:02:07,158 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:02:07,160 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,160 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 04:02:07,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:07,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:07,160 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:07,160 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-26 04:02:07,160 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,160 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:07,160 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 04:02:07,161 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-26 04:02:07,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:07,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:07,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,162 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:07,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-26 04:02:07,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:02:07,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:07,164 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:02:07,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:02:07,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-26 04:02:07,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:07,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:07,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:07,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,44553,1695700858629': 2023-09-26 04:02:07,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-26 04:02:07,168 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-26 04:02:07,168 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:02:07,168 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:02:07,168 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,168 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:02:07,174 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,174 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,174 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:07,174 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:07,174 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,174 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,175 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:07,175 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:07,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:07,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:07,175 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,176 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:07,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,178 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:07,178 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,179 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,182 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,182 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:07,182 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,182 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:07,183 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:07,183 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:07,183 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:07,182 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:07,184 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,183 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:07,183 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:07,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,185 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:07,185 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:07,185 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:07,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:02:07,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:07,185 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:07,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:07,186 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:07,186 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,186 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,186 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926881326bb48b0433fa6f45e2aac948844, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309262da218f15cfc443186c169c3a8bd20b6] mob files 2023-09-26 04:02:07,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926881326bb48b0433fa6f45e2aac948844 2023-09-26 04:02:07,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309262da218f15cfc443186c169c3a8bd20b6 2023-09-26 04:02:07,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-26 04:02:07,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,216 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:07,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695700927061Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695700927198 (+137 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695700927198Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695700927198Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695700927201 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695700927210 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695700927216 (+6 ms) 2023-09-26 04:02:07,218 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-26 04:02:07,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 156 msec 2023-09-26 04:02:07,364 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:07,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-26 04:02:07,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:02:07,395 DEBUG [Listener at jenkins-hbase20.apache.org/39825] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 04:02:07,398 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 04:02:07,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34445] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-26 04:02:07,401 DEBUG [Listener at jenkins-hbase20.apache.org/39825] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 04:02:07,404 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 04:02:07,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-26 04:02:07,404 DEBUG [Listener at jenkins-hbase20.apache.org/39825] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-26 04:02:07,407 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-26 04:02:07,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44553] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-26 04:02:07,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-26 04:02:07,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:07,413 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 04:02:07,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-26 04:02:07,413 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 04:02:07,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-26 04:02:07,416 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:07,416 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:07,416 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588 empty. 2023-09-26 04:02:07,416 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491 empty. 2023-09-26 04:02:07,417 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:07,417 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:07,417 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-26 04:02:07,427 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-26 04:02:07,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => b243fc0209f171ce4bf120a001357588, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:02:07,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => c9ba5f60b18b7a7f86f7184344ab0491, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:02:07,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:07,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing c9ba5f60b18b7a7f86f7184344ab0491, disabling compactions & flushes 2023-09-26 04:02:07,439 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:07,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:07,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:07,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. after waiting 0 ms 2023-09-26 04:02:07,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing b243fc0209f171ce4bf120a001357588, disabling compactions & flushes 2023-09-26 04:02:07,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:07,439 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:07,439 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:07,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:07,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for c9ba5f60b18b7a7f86f7184344ab0491: 2023-09-26 04:02:07,440 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. after waiting 0 ms 2023-09-26 04:02:07,440 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:07,440 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:07,440 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for b243fc0209f171ce4bf120a001357588: 2023-09-26 04:02:07,442 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 04:02:07,443 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700927442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700927442"}]},"ts":"1695700927442"} 2023-09-26 04:02:07,443 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700927442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700927442"}]},"ts":"1695700927442"} 2023-09-26 04:02:07,444 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 04:02:07,445 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 04:02:07,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700927445"}]},"ts":"1695700927445"} 2023-09-26 04:02:07,446 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-26 04:02:07,448 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:02:07,449 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:02:07,449 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:02:07,449 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:02:07,449 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:02:07,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b243fc0209f171ce4bf120a001357588, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9ba5f60b18b7a7f86f7184344ab0491, ASSIGN}] 2023-09-26 04:02:07,452 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9ba5f60b18b7a7f86f7184344ab0491, ASSIGN 2023-09-26 04:02:07,452 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b243fc0209f171ce4bf120a001357588, ASSIGN 2023-09-26 04:02:07,453 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9ba5f60b18b7a7f86f7184344ab0491, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34445,1695700858593; forceNewPlan=false, retain=false 2023-09-26 04:02:07,453 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b243fc0209f171ce4bf120a001357588, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43719,1695700858548; forceNewPlan=false, retain=false 2023-09-26 04:02:07,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-26 04:02:07,603 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 04:02:07,609 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b243fc0209f171ce4bf120a001357588, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,609 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c9ba5f60b18b7a7f86f7184344ab0491, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,610 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700927609"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700927609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700927609"}]},"ts":"1695700927609"} 2023-09-26 04:02:07,610 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700927609"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700927609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700927609"}]},"ts":"1695700927609"} 2023-09-26 04:02:07,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure b243fc0209f171ce4bf120a001357588, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:02:07,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure c9ba5f60b18b7a7f86f7184344ab0491, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:02:07,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-26 04:02:07,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:07,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:07,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9ba5f60b18b7a7f86f7184344ab0491, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.', STARTKEY => '2', ENDKEY => ''} 2023-09-26 04:02:07,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b243fc0209f171ce4bf120a001357588, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.', STARTKEY => '', ENDKEY => '2'} 2023-09-26 04:02:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. service=AccessControlService 2023-09-26 04:02:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. service=AccessControlService 2023-09-26 04:02:07,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:02:07,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:02:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:07,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:07,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:07,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:07,778 INFO [StoreOpener-c9ba5f60b18b7a7f86f7184344ab0491-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:07,778 INFO [StoreOpener-b243fc0209f171ce4bf120a001357588-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:07,780 DEBUG [StoreOpener-c9ba5f60b18b7a7f86f7184344ab0491-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/cf 2023-09-26 04:02:07,780 DEBUG [StoreOpener-c9ba5f60b18b7a7f86f7184344ab0491-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/cf 2023-09-26 04:02:07,780 DEBUG [StoreOpener-b243fc0209f171ce4bf120a001357588-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/cf 2023-09-26 04:02:07,780 DEBUG [StoreOpener-b243fc0209f171ce4bf120a001357588-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/cf 2023-09-26 04:02:07,780 INFO [StoreOpener-c9ba5f60b18b7a7f86f7184344ab0491-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9ba5f60b18b7a7f86f7184344ab0491 columnFamilyName cf 2023-09-26 04:02:07,780 INFO [StoreOpener-b243fc0209f171ce4bf120a001357588-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b243fc0209f171ce4bf120a001357588 columnFamilyName cf 2023-09-26 04:02:07,781 INFO [StoreOpener-c9ba5f60b18b7a7f86f7184344ab0491-1] regionserver.HStore(310): Store=c9ba5f60b18b7a7f86f7184344ab0491/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:02:07,781 INFO [StoreOpener-b243fc0209f171ce4bf120a001357588-1] regionserver.HStore(310): Store=b243fc0209f171ce4bf120a001357588/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:02:07,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:07,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:07,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:07,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:07,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:07,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:07,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:02:07,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:02:07,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b243fc0209f171ce4bf120a001357588; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65143348, jitterRate=-0.02928847074508667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:02:07,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c9ba5f60b18b7a7f86f7184344ab0491; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62807620, jitterRate=-0.06409353017807007}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:02:07,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b243fc0209f171ce4bf120a001357588: 2023-09-26 04:02:07,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c9ba5f60b18b7a7f86f7184344ab0491: 2023-09-26 04:02:07,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588., pid=69, masterSystemTime=1695700927767 2023-09-26 04:02:07,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491., pid=70, masterSystemTime=1695700927768 2023-09-26 04:02:07,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:07,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:07,791 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b243fc0209f171ce4bf120a001357588, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:07,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:07,791 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700927791"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700927791"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700927791"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700927791"}]},"ts":"1695700927791"} 2023-09-26 04:02:07,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:07,792 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c9ba5f60b18b7a7f86f7184344ab0491, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:07,792 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700927792"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700927792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700927792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700927792"}]},"ts":"1695700927792"} 2023-09-26 04:02:07,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-26 04:02:07,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure b243fc0209f171ce4bf120a001357588, server=jenkins-hbase20.apache.org,43719,1695700858548 in 179 msec 2023-09-26 04:02:07,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-26 04:02:07,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure c9ba5f60b18b7a7f86f7184344ab0491, server=jenkins-hbase20.apache.org,34445,1695700858593 in 178 msec 2023-09-26 04:02:07,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b243fc0209f171ce4bf120a001357588, ASSIGN in 346 msec 2023-09-26 04:02:07,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-26 04:02:07,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9ba5f60b18b7a7f86f7184344ab0491, ASSIGN in 346 msec 2023-09-26 04:02:07,797 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 04:02:07,797 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700927797"}]},"ts":"1695700927797"} 2023-09-26 04:02:07,799 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-26 04:02:07,800 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 04:02:07,801 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-26 04:02:07,802 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-26 04:02:07,803 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:07,803 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:07,803 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:07,803 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:07,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:07,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:07,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:07,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:07,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:07,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:07,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:07,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:07,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 394 msec 2023-09-26 04:02:08,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-26 04:02:08,023 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-26 04:02:08,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions b243fc0209f171ce4bf120a001357588, c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:08,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b243fc0209f171ce4bf120a001357588, c9ba5f60b18b7a7f86f7184344ab0491], force=true 2023-09-26 04:02:08,063 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b243fc0209f171ce4bf120a001357588, c9ba5f60b18b7a7f86f7184344ab0491], force=true 2023-09-26 04:02:08,063 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b243fc0209f171ce4bf120a001357588, c9ba5f60b18b7a7f86f7184344ab0491], force=true 2023-09-26 04:02:08,063 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b243fc0209f171ce4bf120a001357588, c9ba5f60b18b7a7f86f7184344ab0491], force=true 2023-09-26 04:02:08,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 04:02:08,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b243fc0209f171ce4bf120a001357588, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9ba5f60b18b7a7f86f7184344ab0491, UNASSIGN}] 2023-09-26 04:02:08,086 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b243fc0209f171ce4bf120a001357588, UNASSIGN 2023-09-26 04:02:08,087 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9ba5f60b18b7a7f86f7184344ab0491, UNASSIGN 2023-09-26 04:02:08,087 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c9ba5f60b18b7a7f86f7184344ab0491, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:08,087 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b243fc0209f171ce4bf120a001357588, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:08,088 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700928087"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700928087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700928087"}]},"ts":"1695700928087"} 2023-09-26 04:02:08,088 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700928087"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700928087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700928087"}]},"ts":"1695700928087"} 2023-09-26 04:02:08,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure c9ba5f60b18b7a7f86f7184344ab0491, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:02:08,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure b243fc0209f171ce4bf120a001357588, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:02:08,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 04:02:08,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:08,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c9ba5f60b18b7a7f86f7184344ab0491, disabling compactions & flushes 2023-09-26 04:02:08,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:08,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:08,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. after waiting 0 ms 2023-09-26 04:02:08,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:08,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing c9ba5f60b18b7a7f86f7184344ab0491 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-26 04:02:08,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:08,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b243fc0209f171ce4bf120a001357588, disabling compactions & flushes 2023-09-26 04:02:08,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:08,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:08,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. after waiting 0 ms 2023-09-26 04:02:08,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:08,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing b243fc0209f171ce4bf120a001357588 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-26 04:02:08,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/.tmp/cf/9cc14db5de674e3e81a477c8819d1e9f 2023-09-26 04:02:08,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/.tmp/cf/6ca223fb11c74e3882778ef492bc4fef 2023-09-26 04:02:08,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/.tmp/cf/6ca223fb11c74e3882778ef492bc4fef as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/cf/6ca223fb11c74e3882778ef492bc4fef 2023-09-26 04:02:08,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/.tmp/cf/9cc14db5de674e3e81a477c8819d1e9f as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/cf/9cc14db5de674e3e81a477c8819d1e9f 2023-09-26 04:02:08,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/cf/9cc14db5de674e3e81a477c8819d1e9f, entries=1, sequenceid=5, filesize=4.7 K 2023-09-26 04:02:08,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/cf/6ca223fb11c74e3882778ef492bc4fef, entries=1, sequenceid=5, filesize=4.7 K 2023-09-26 04:02:08,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c9ba5f60b18b7a7f86f7184344ab0491 in 33ms, sequenceid=5, compaction requested=false 2023-09-26 04:02:08,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b243fc0209f171ce4bf120a001357588 in 31ms, sequenceid=5, compaction requested=false 2023-09-26 04:02:08,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-26 04:02:08,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-26 04:02:08,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-26 04:02:08,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-26 04:02:08,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:08,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491. 2023-09-26 04:02:08,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:08,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c9ba5f60b18b7a7f86f7184344ab0491: 2023-09-26 04:02:08,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588. 2023-09-26 04:02:08,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b243fc0209f171ce4bf120a001357588: 2023-09-26 04:02:08,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:08,286 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b243fc0209f171ce4bf120a001357588, regionState=CLOSED 2023-09-26 04:02:08,287 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700928286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700928286"}]},"ts":"1695700928286"} 2023-09-26 04:02:08,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:08,287 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c9ba5f60b18b7a7f86f7184344ab0491, regionState=CLOSED 2023-09-26 04:02:08,287 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695700928287"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700928287"}]},"ts":"1695700928287"} 2023-09-26 04:02:08,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-26 04:02:08,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure b243fc0209f171ce4bf120a001357588, server=jenkins-hbase20.apache.org,43719,1695700858548 in 199 msec 2023-09-26 04:02:08,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-26 04:02:08,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure c9ba5f60b18b7a7f86f7184344ab0491, server=jenkins-hbase20.apache.org,34445,1695700858593 in 199 msec 2023-09-26 04:02:08,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b243fc0209f171ce4bf120a001357588, UNASSIGN in 209 msec 2023-09-26 04:02:08,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-26 04:02:08,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9ba5f60b18b7a7f86f7184344ab0491, UNASSIGN in 206 msec 2023-09-26 04:02:08,332 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-26 04:02:08,334 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927409.b243fc0209f171ce4bf120a001357588.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:08,335 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695700927409.c9ba5f60b18b7a7f86f7184344ab0491.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:08,335 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:08,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 04:02:08,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7afa82f9202be17fe875c7108ef4efa, ASSIGN}] 2023-09-26 04:02:08,380 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7afa82f9202be17fe875c7108ef4efa, ASSIGN 2023-09-26 04:02:08,381 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7afa82f9202be17fe875c7108ef4efa, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,43719,1695700858548; forceNewPlan=false, retain=false 2023-09-26 04:02:08,531 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-26 04:02:08,535 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a7afa82f9202be17fe875c7108ef4efa, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:08,535 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695700928534"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700928534"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700928534"}]},"ts":"1695700928534"} 2023-09-26 04:02:08,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure a7afa82f9202be17fe875c7108ef4efa, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:02:08,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 04:02:08,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. 2023-09-26 04:02:08,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7afa82f9202be17fe875c7108ef4efa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.', STARTKEY => '', ENDKEY => ''} 2023-09-26 04:02:08,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. service=AccessControlService 2023-09-26 04:02:08,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:02:08,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:08,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:08,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:08,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:08,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/.regioninfo 2023-09-26 04:02:08,707 INFO [StoreOpener-a7afa82f9202be17fe875c7108ef4efa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:08,708 DEBUG [StoreOpener-a7afa82f9202be17fe875c7108ef4efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf 2023-09-26 04:02:08,708 DEBUG [StoreOpener-a7afa82f9202be17fe875c7108ef4efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf 2023-09-26 04:02:08,708 INFO [StoreOpener-a7afa82f9202be17fe875c7108ef4efa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7afa82f9202be17fe875c7108ef4efa columnFamilyName cf 2023-09-26 04:02:08,735 DEBUG [StoreOpener-a7afa82f9202be17fe875c7108ef4efa-1] regionserver.HStore(539): loaded hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/6ca223fb11c74e3882778ef492bc4fef.b243fc0209f171ce4bf120a001357588->hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/cf/6ca223fb11c74e3882778ef492bc4fef-top 2023-09-26 04:02:08,740 DEBUG [StoreOpener-a7afa82f9202be17fe875c7108ef4efa-1] regionserver.HStore(539): loaded hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/9cc14db5de674e3e81a477c8819d1e9f.c9ba5f60b18b7a7f86f7184344ab0491->hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/cf/9cc14db5de674e3e81a477c8819d1e9f-top 2023-09-26 04:02:08,741 INFO [StoreOpener-a7afa82f9202be17fe875c7108ef4efa-1] regionserver.HStore(310): Store=a7afa82f9202be17fe875c7108ef4efa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:02:08,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:08,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:08,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:08,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a7afa82f9202be17fe875c7108ef4efa; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67264165, jitterRate=0.002314165234565735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:02:08,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a7afa82f9202be17fe875c7108ef4efa: 2023-09-26 04:02:08,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa., pid=77, masterSystemTime=1695700928694 2023-09-26 04:02:08,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.,because compaction is disabled. 2023-09-26 04:02:08,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. 2023-09-26 04:02:08,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. 2023-09-26 04:02:08,750 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a7afa82f9202be17fe875c7108ef4efa, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:08,751 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695700928750"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700928750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700928750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700928750"}]},"ts":"1695700928750"} 2023-09-26 04:02:08,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-26 04:02:08,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure a7afa82f9202be17fe875c7108ef4efa, server=jenkins-hbase20.apache.org,43719,1695700858548 in 213 msec 2023-09-26 04:02:08,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-26 04:02:08,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7afa82f9202be17fe875c7108ef4efa, ASSIGN in 375 msec 2023-09-26 04:02:08,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b243fc0209f171ce4bf120a001357588, c9ba5f60b18b7a7f86f7184344ab0491], force=true in 699 msec 2023-09-26 04:02:09,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-26 04:02:09,173 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-26 04:02:09,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-26 04:02:09,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700929176 (current time:1695700929176). 2023-09-26 04:02:09,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:02:09,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x0e461139 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:09,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e0908ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:09,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:09,192 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:09,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e461139 to 127.0.0.1:55155 2023-09-26 04:02:09,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:09,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x758158f2 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:09,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bf040a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:09,202 DEBUG [hconnection-0x4d386f4a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:09,205 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:09,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:09,212 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:09,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x758158f2 to 127.0.0.1:55155 2023-09-26 04:02:09,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:09,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-26 04:02:09,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:02:09,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-26 04:02:09,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-26 04:02:09,217 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-26 04:02:09,218 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695701529218 2023-09-26 04:02:09,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-26 04:02:09,222 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:02:09,222 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:02:09,224 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-26 04:02:09,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-26 04:02:09,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-09-26 04:02:09,226 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-26 04:02:09,227 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695701529227 2023-09-26 04:02:09,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,236 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-26 04:02:09,236 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:09,237 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-26 04:02:09,237 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-26 04:02:09,238 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,238 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,238 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:09,238 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:09,238 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:09,238 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:09,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:09,239 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,239 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:02:09,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:09,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-26 04:02:09,240 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-26 04:02:09,240 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:09,241 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-26 04:02:09,242 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-26 04:02:09,242 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,242 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-26 04:02:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-26 04:02:09,244 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-26 04:02:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-26 04:02:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-26 04:02:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-26 04:02:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-26 04:02:09,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-26 04:02:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:09,245 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-26 04:02:09,245 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-26 04:02:09,245 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-26 04:02:09,249 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,249 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,249 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,249 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,249 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:09,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:09,249 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,249 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:09,250 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:09,250 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,250 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:09,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:09,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:09,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-26 04:02:09,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ffd2408[Count = 0] remaining members to acquire global barrier 2023-09-26 04:02:09,251 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-26 04:02:09,252 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,252 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,252 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,252 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,252 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,252 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:02:09,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,253 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-26 04:02:09,253 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-26 04:02:09,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,253 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:02:09,253 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-26 04:02:09,253 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-26 04:02:09,253 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-26 04:02:09,253 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:02:09,253 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:09,253 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:09,253 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. 2023-09-26 04:02:09,253 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. started... 2023-09-26 04:02:09,255 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7afa82f9202be17fe875c7108ef4efa: 2023-09-26 04:02:09,255 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,255 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:09,255 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/6ca223fb11c74e3882778ef492bc4fef.b243fc0209f171ce4bf120a001357588->hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/cf/6ca223fb11c74e3882778ef492bc4fef-top, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/9cc14db5de674e3e81a477c8819d1e9f.c9ba5f60b18b7a7f86f7184344ab0491->hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/cf/9cc14db5de674e3e81a477c8819d1e9f-top] hfiles 2023-09-26 04:02:09,255 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/6ca223fb11c74e3882778ef492bc4fef.b243fc0209f171ce4bf120a001357588 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,255 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-26 04:02:09,255 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-26 04:02:09,255 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:09,255 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:09,255 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-26 04:02:09,257 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-26 04:02:09,261 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/9cc14db5de674e3e81a477c8819d1e9f.c9ba5f60b18b7a7f86f7184344ab0491 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,267 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. completed. 2023-09-26 04:02:09,267 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. 2023-09-26 04:02:09,267 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:09,267 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:09,267 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,267 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-26 04:02:09,268 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:02:09,270 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,270 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-26 04:02:09,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:09,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:09,270 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:09,271 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-26 04:02:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:09,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:09,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:09,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,43719,1695700858548': 2023-09-26 04:02:09,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-26 04:02:09,273 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-26 04:02:09,273 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:02:09,273 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:02:09,273 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,273 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:02:09,274 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,274 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:09,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:09,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:09,275 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:09,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:09,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:09,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:09,276 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,276 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:09,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:09,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:09,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:09,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,279 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:09,279 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:09,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:09,279 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:09,282 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:09,282 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:09,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:09,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:09,282 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:09,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,282 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:09,282 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:09,282 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:09,282 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:09,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:09,283 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:09,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:09,283 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:09,283 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:09,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,283 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,284 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,284 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:09,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:09,284 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,284 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:09,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:09,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:09,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:09,284 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:09,284 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,284 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-26 04:02:09,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,305 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695700929218Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695700929282 (+64 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695700929283 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695700929286 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695700929297 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695700929305 (+8 ms) 2023-09-26 04:02:09,308 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-26 04:02:09,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 86 msec 2023-09-26 04:02:09,324 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:09,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-26 04:02:09,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:02:09,325 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325 2023-09-26 04:02:09,325 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36857, tgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325, rawTgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325, srcFsUri=hdfs://localhost:36857, srcDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:02:09,351 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:02:09,352 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1562395131_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,352 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa, snapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-26 04:02:09,360 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:09,381 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:09,382 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:09,382 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:09,382 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:10,085 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-7996939978078430590.jar 2023-09-26 04:02:10,086 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:10,086 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:10,139 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-6147912649698067115.jar 2023-09-26 04:02:10,139 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:10,140 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:10,140 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:10,140 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:10,141 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:10,141 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:10,141 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 04:02:10,142 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 04:02:10,142 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 04:02:10,142 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 04:02:10,142 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 04:02:10,143 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 04:02:10,143 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 04:02:10,144 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 04:02:10,144 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 04:02:10,144 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 04:02:10,145 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:10,145 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:10,146 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:02:10,146 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:10,146 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:10,147 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:02:10,147 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:02:10,206 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0004_000001 (auth:SIMPLE) 2023-09-26 04:02:10,502 WARN [Listener at jenkins-hbase20.apache.org/39825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 04:02:10,504 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-26 04:02:10,506 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-26 04:02:10,555 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:02:10,555 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:02:11,045 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0005_000001 (auth:SIMPLE) 2023-09-26 04:02:11,288 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 04:02:14,344 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0005_000001 (auth:SIMPLE) 2023-09-26 04:02:16,538 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0005_000001 (auth:SIMPLE) 2023-09-26 04:02:18,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0005_000001 (auth:SIMPLE) 2023-09-26 04:02:18,582 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695700864748_0005_01_000002 is : 143 2023-09-26 04:02:19,667 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 04:02:19,667 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 04:02:19,674 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:19,675 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 04:02:19,675 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 04:02:19,675 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:19,676 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-26 04:02:19,676 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-26 04:02:19,676 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:19,676 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-26 04:02:19,677 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700929325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-26 04:02:19,682 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:19,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:19,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:19,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-26 04:02:19,686 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700939686"}]},"ts":"1695700939686"} 2023-09-26 04:02:19,688 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-26 04:02:19,689 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-26 04:02:19,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7afa82f9202be17fe875c7108ef4efa, UNASSIGN}] 2023-09-26 04:02:19,691 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7afa82f9202be17fe875c7108ef4efa, UNASSIGN 2023-09-26 04:02:19,692 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a7afa82f9202be17fe875c7108ef4efa, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:19,692 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695700939692"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700939692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700939692"}]},"ts":"1695700939692"} 2023-09-26 04:02:19,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure a7afa82f9202be17fe875c7108ef4efa, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:02:19,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-26 04:02:19,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:19,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a7afa82f9202be17fe875c7108ef4efa, disabling compactions & flushes 2023-09-26 04:02:19,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. 2023-09-26 04:02:19,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. 2023-09-26 04:02:19,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. after waiting 0 ms 2023-09-26 04:02:19,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. 2023-09-26 04:02:19,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-26 04:02:19,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:19,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa. 2023-09-26 04:02:19,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a7afa82f9202be17fe875c7108ef4efa: 2023-09-26 04:02:19,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:19,861 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a7afa82f9202be17fe875c7108ef4efa, regionState=CLOSED 2023-09-26 04:02:19,861 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695700939861"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700939861"}]},"ts":"1695700939861"} 2023-09-26 04:02:19,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-26 04:02:19,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure a7afa82f9202be17fe875c7108ef4efa, server=jenkins-hbase20.apache.org,43719,1695700858548 in 170 msec 2023-09-26 04:02:19,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-26 04:02:19,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7afa82f9202be17fe875c7108ef4efa, UNASSIGN in 175 msec 2023-09-26 04:02:19,866 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700939866"}]},"ts":"1695700939866"} 2023-09-26 04:02:19,867 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-26 04:02:19,868 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-26 04:02:19,870 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-09-26 04:02:19,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-26 04:02:19,991 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-26 04:02:19,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:19,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:19,999 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:19,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,001 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,002 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,004 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,004 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,004 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-26 04:02:20,004 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-26 04:02:20,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-26 04:02:20,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:20,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:20,005 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:20,005 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:20,006 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:20,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-26 04:02:20,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:20,006 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 04:02:20,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:20,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:20,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-26 04:02:20,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:20,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:20,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:20,007 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/recovered.edits] 2023-09-26 04:02:20,007 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/recovered.edits] 2023-09-26 04:02:20,007 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/recovered.edits] 2023-09-26 04:02:20,010 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/cf/9cc14db5de674e3e81a477c8819d1e9f to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/cf/9cc14db5de674e3e81a477c8819d1e9f 2023-09-26 04:02:20,011 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/6ca223fb11c74e3882778ef492bc4fef.b243fc0209f171ce4bf120a001357588 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/6ca223fb11c74e3882778ef492bc4fef.b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:20,011 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/cf/6ca223fb11c74e3882778ef492bc4fef to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/cf/6ca223fb11c74e3882778ef492bc4fef 2023-09-26 04:02:20,012 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/9cc14db5de674e3e81a477c8819d1e9f.c9ba5f60b18b7a7f86f7184344ab0491 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/cf/9cc14db5de674e3e81a477c8819d1e9f.c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:20,013 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/recovered.edits/8.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491/recovered.edits/8.seqid 2023-09-26 04:02:20,013 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/recovered.edits/8.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588/recovered.edits/8.seqid 2023-09-26 04:02:20,013 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9ba5f60b18b7a7f86f7184344ab0491 2023-09-26 04:02:20,013 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b243fc0209f171ce4bf120a001357588 2023-09-26 04:02:20,014 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/recovered.edits/12.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa/recovered.edits/12.seqid 2023-09-26 04:02:20,014 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7afa82f9202be17fe875c7108ef4efa 2023-09-26 04:02:20,014 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-26 04:02:20,016 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,018 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-26 04:02:20,019 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-26 04:02:20,020 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,020 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-26 04:02:20,020 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700940020"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:20,023 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-26 04:02:20,023 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a7afa82f9202be17fe875c7108ef4efa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695700927410.a7afa82f9202be17fe875c7108ef4efa.', STARTKEY => '', ENDKEY => ''}] 2023-09-26 04:02:20,023 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-26 04:02:20,023 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695700940023"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:20,024 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-26 04:02:20,026 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,026 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-09-26 04:02:20,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-26 04:02:20,109 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-26 04:02:20,110 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-26 04:02:20,118 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700940118"}]},"ts":"1695700940118"} 2023-09-26 04:02:20,121 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-26 04:02:20,123 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-26 04:02:20,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17c30abaaeef21aaf7ff010a7501e70e, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca4497896fd8f0de7912db04677ed8af, UNASSIGN}] 2023-09-26 04:02:20,125 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca4497896fd8f0de7912db04677ed8af, UNASSIGN 2023-09-26 04:02:20,125 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17c30abaaeef21aaf7ff010a7501e70e, UNASSIGN 2023-09-26 04:02:20,126 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ca4497896fd8f0de7912db04677ed8af, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:20,126 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=17c30abaaeef21aaf7ff010a7501e70e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:20,126 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700940126"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700940126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700940126"}]},"ts":"1695700940126"} 2023-09-26 04:02:20,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700940126"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700940126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700940126"}]},"ts":"1695700940126"} 2023-09-26 04:02:20,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 17c30abaaeef21aaf7ff010a7501e70e, server=jenkins-hbase20.apache.org,44553,1695700858629}] 2023-09-26 04:02:20,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure ca4497896fd8f0de7912db04677ed8af, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:02:20,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-26 04:02:20,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:20,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:20,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 17c30abaaeef21aaf7ff010a7501e70e, disabling compactions & flushes 2023-09-26 04:02:20,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ca4497896fd8f0de7912db04677ed8af, disabling compactions & flushes 2023-09-26 04:02:20,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:20,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:20,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:20,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:20,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. after waiting 0 ms 2023-09-26 04:02:20,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:20,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. after waiting 0 ms 2023-09-26 04:02:20,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:20,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:02:20,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:02:20,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:20,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:20,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e. 2023-09-26 04:02:20,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af. 2023-09-26 04:02:20,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 17c30abaaeef21aaf7ff010a7501e70e: 2023-09-26 04:02:20,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ca4497896fd8f0de7912db04677ed8af: 2023-09-26 04:02:20,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:20,302 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ca4497896fd8f0de7912db04677ed8af, regionState=CLOSED 2023-09-26 04:02:20,303 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700940302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700940302"}]},"ts":"1695700940302"} 2023-09-26 04:02:20,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:20,303 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=17c30abaaeef21aaf7ff010a7501e70e, regionState=CLOSED 2023-09-26 04:02:20,303 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695700940303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700940303"}]},"ts":"1695700940303"} 2023-09-26 04:02:20,306 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-26 04:02:20,306 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure ca4497896fd8f0de7912db04677ed8af, server=jenkins-hbase20.apache.org,34445,1695700858593 in 176 msec 2023-09-26 04:02:20,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-26 04:02:20,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 17c30abaaeef21aaf7ff010a7501e70e, server=jenkins-hbase20.apache.org,44553,1695700858629 in 177 msec 2023-09-26 04:02:20,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca4497896fd8f0de7912db04677ed8af, UNASSIGN in 183 msec 2023-09-26 04:02:20,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-26 04:02:20,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17c30abaaeef21aaf7ff010a7501e70e, UNASSIGN in 183 msec 2023-09-26 04:02:20,308 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700940308"}]},"ts":"1695700940308"} 2023-09-26 04:02:20,309 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-26 04:02:20,310 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-26 04:02:20,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 200 msec 2023-09-26 04:02:20,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-26 04:02:20,423 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-26 04:02:20,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,432 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,433 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,434 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,435 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,435 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,435 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,435 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-26 04:02:20,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-26 04:02:20,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-26 04:02:20,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-26 04:02:20,436 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,436 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,436 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,436 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:20,436 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,436 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:20,437 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:20,436 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:20,437 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:20,437 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:20,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-26 04:02:20,439 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/recovered.edits] 2023-09-26 04:02:20,439 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/recovered.edits] 2023-09-26 04:02:20,442 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/cf/d8d34ae5d40242c0afdeda5755756846 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/cf/d8d34ae5d40242c0afdeda5755756846 2023-09-26 04:02:20,442 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/cf/b30b411fa46b42c98e312c4feb13fda3 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/cf/b30b411fa46b42c98e312c4feb13fda3 2023-09-26 04:02:20,445 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af/recovered.edits/9.seqid 2023-09-26 04:02:20,445 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e/recovered.edits/9.seqid 2023-09-26 04:02:20,445 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca4497896fd8f0de7912db04677ed8af 2023-09-26 04:02:20,445 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17c30abaaeef21aaf7ff010a7501e70e 2023-09-26 04:02:20,446 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-26 04:02:20,446 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-26 04:02:20,447 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-26 04:02:20,449 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926881326bb48b0433fa6f45e2aac948844 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230926881326bb48b0433fa6f45e2aac948844 2023-09-26 04:02:20,450 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309262da218f15cfc443186c169c3a8bd20b6 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309262da218f15cfc443186c169c3a8bd20b6 2023-09-26 04:02:20,451 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-26 04:02:20,452 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,454 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-26 04:02:20,455 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-26 04:02:20,456 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,457 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-26 04:02:20,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700940457"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:20,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700940457"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:20,458 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 04:02:20,458 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 17c30abaaeef21aaf7ff010a7501e70e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695700926023.17c30abaaeef21aaf7ff010a7501e70e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ca4497896fd8f0de7912db04677ed8af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695700926023.ca4497896fd8f0de7912db04677ed8af.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 04:02:20,458 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-26 04:02:20,458 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695700940458"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:20,460 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-26 04:02:20,461 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-26 04:02:20,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-26 04:02:20,540 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-26 04:02:20,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-26 04:02:20,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-26 04:02:20,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-26 04:02:20,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-26 04:02:20,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-26 04:02:20,588 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 758) Potentially hanging thread: Thread-4067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1542791596) connection to jenkins-hbase20.apache.org/148.251.75.209:39391 from appattempt_1695700864748_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6d03649-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:54688 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1223184270_1 at /127.0.0.1:48244 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:48274 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1223184270_1 at /127.0.0.1:58272 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1542791596) connection to jenkins-hbase20.apache.org/148.251.75.209:39787 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=124 (was 139), ProcessCount=167 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=7434 (was 7482) 2023-09-26 04:02:20,589 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-26 04:02:20,608 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=124, ProcessCount=167, AvailableMemoryMB=7433 2023-09-26 04:02:20,608 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-26 04:02:20,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 04:02:20,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 04:02:20,613 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 04:02:20,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-26 04:02:20,613 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 04:02:20,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-26 04:02:20,616 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:20,616 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:20,616 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9 empty. 2023-09-26 04:02:20,616 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713 empty. 2023-09-26 04:02:20,617 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:20,617 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:20,617 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-26 04:02:20,626 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-26 04:02:20,628 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => dc4051de02a3799653e5df63fd0d0713, NAME => 'testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:02:20,628 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0e107c0a4104527d21a040381be341d9, NAME => 'testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:02:20,642 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:20,642 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0e107c0a4104527d21a040381be341d9, disabling compactions & flushes 2023-09-26 04:02:20,642 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:20,643 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:20,643 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing dc4051de02a3799653e5df63fd0d0713, disabling compactions & flushes 2023-09-26 04:02:20,643 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:20,643 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:20,643 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. after waiting 0 ms 2023-09-26 04:02:20,643 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:20,643 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:20,643 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. after waiting 0 ms 2023-09-26 04:02:20,643 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:20,643 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:20,643 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0e107c0a4104527d21a040381be341d9: 2023-09-26 04:02:20,643 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:20,644 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for dc4051de02a3799653e5df63fd0d0713: 2023-09-26 04:02:20,646 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 04:02:20,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700940647"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700940647"}]},"ts":"1695700940647"} 2023-09-26 04:02:20,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700940647"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700940647"}]},"ts":"1695700940647"} 2023-09-26 04:02:20,649 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 04:02:20,649 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 04:02:20,649 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700940649"}]},"ts":"1695700940649"} 2023-09-26 04:02:20,650 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-26 04:02:20,653 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:02:20,654 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:02:20,654 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:02:20,654 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:02:20,654 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:02:20,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e107c0a4104527d21a040381be341d9, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc4051de02a3799653e5df63fd0d0713, ASSIGN}] 2023-09-26 04:02:20,656 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e107c0a4104527d21a040381be341d9, ASSIGN 2023-09-26 04:02:20,656 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc4051de02a3799653e5df63fd0d0713, ASSIGN 2023-09-26 04:02:20,657 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e107c0a4104527d21a040381be341d9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34445,1695700858593; forceNewPlan=false, retain=false 2023-09-26 04:02:20,657 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc4051de02a3799653e5df63fd0d0713, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43719,1695700858548; forceNewPlan=false, retain=false 2023-09-26 04:02:20,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-26 04:02:20,807 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 04:02:20,813 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=dc4051de02a3799653e5df63fd0d0713, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:20,813 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0e107c0a4104527d21a040381be341d9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:20,813 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700940812"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700940812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700940812"}]},"ts":"1695700940812"} 2023-09-26 04:02:20,813 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700940812"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700940812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700940812"}]},"ts":"1695700940812"} 2023-09-26 04:02:20,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure dc4051de02a3799653e5df63fd0d0713, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:02:20,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 0e107c0a4104527d21a040381be341d9, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:02:20,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-26 04:02:20,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:20,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e107c0a4104527d21a040381be341d9, NAME => 'testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 04:02:20,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. service=AccessControlService 2023-09-26 04:02:20,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:20,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc4051de02a3799653e5df63fd0d0713, NAME => 'testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 04:02:20,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:02:20,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:20,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. service=AccessControlService 2023-09-26 04:02:20,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:20,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:20,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:02:20,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:20,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:20,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:20,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:20,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:20,982 INFO [StoreOpener-0e107c0a4104527d21a040381be341d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:20,982 INFO [StoreOpener-dc4051de02a3799653e5df63fd0d0713-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:20,984 DEBUG [StoreOpener-dc4051de02a3799653e5df63fd0d0713-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/cf 2023-09-26 04:02:20,984 DEBUG [StoreOpener-dc4051de02a3799653e5df63fd0d0713-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/cf 2023-09-26 04:02:20,984 DEBUG [StoreOpener-0e107c0a4104527d21a040381be341d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/cf 2023-09-26 04:02:20,984 DEBUG [StoreOpener-0e107c0a4104527d21a040381be341d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/cf 2023-09-26 04:02:20,984 INFO [StoreOpener-dc4051de02a3799653e5df63fd0d0713-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc4051de02a3799653e5df63fd0d0713 columnFamilyName cf 2023-09-26 04:02:20,984 INFO [StoreOpener-0e107c0a4104527d21a040381be341d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e107c0a4104527d21a040381be341d9 columnFamilyName cf 2023-09-26 04:02:20,986 INFO [StoreOpener-0e107c0a4104527d21a040381be341d9-1] regionserver.HStore(310): Store=0e107c0a4104527d21a040381be341d9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:02:20,986 INFO [StoreOpener-dc4051de02a3799653e5df63fd0d0713-1] regionserver.HStore(310): Store=dc4051de02a3799653e5df63fd0d0713/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:02:20,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:20,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:20,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:20,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:20,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:20,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:20,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:02:20,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:02:20,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened dc4051de02a3799653e5df63fd0d0713; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68567068, jitterRate=0.021728932857513428}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:02:20,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0e107c0a4104527d21a040381be341d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65529462, jitterRate=-0.023534923791885376}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:02:20,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for dc4051de02a3799653e5df63fd0d0713: 2023-09-26 04:02:20,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0e107c0a4104527d21a040381be341d9: 2023-09-26 04:02:20,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9., pid=94, masterSystemTime=1695700940971 2023-09-26 04:02:20,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713., pid=93, masterSystemTime=1695700940971 2023-09-26 04:02:20,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:20,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:20,995 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0e107c0a4104527d21a040381be341d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:20,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:20,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:20,995 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700940995"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700940995"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700940995"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700940995"}]},"ts":"1695700940995"} 2023-09-26 04:02:20,995 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=dc4051de02a3799653e5df63fd0d0713, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:20,996 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700940995"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700940995"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700940995"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700940995"}]},"ts":"1695700940995"} 2023-09-26 04:02:20,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-26 04:02:20,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 0e107c0a4104527d21a040381be341d9, server=jenkins-hbase20.apache.org,34445,1695700858593 in 177 msec 2023-09-26 04:02:20,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-26 04:02:20,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure dc4051de02a3799653e5df63fd0d0713, server=jenkins-hbase20.apache.org,43719,1695700858548 in 180 msec 2023-09-26 04:02:20,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e107c0a4104527d21a040381be341d9, ASSIGN in 344 msec 2023-09-26 04:02:20,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-26 04:02:20,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc4051de02a3799653e5df63fd0d0713, ASSIGN in 344 msec 2023-09-26 04:02:21,000 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 04:02:21,000 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700941000"}]},"ts":"1695700941000"} 2023-09-26 04:02:21,001 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-26 04:02:21,002 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 04:02:21,002 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-26 04:02:21,004 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 04:02:21,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:21,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:21,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:21,005 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:21,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:21,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:21,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:21,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:21,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 395 msec 2023-09-26 04:02:21,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-26 04:02:21,222 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-26 04:02:21,228 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-26 04:02:21,228 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:21,232 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:02:21,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:02:21,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700941250 (current time:1695700941250). 2023-09-26 04:02:21,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:02:21,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x2a38c164 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:21,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@110c912a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:21,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:21,263 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:21,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a38c164 to 127.0.0.1:55155 2023-09-26 04:02:21,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:21,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x62b505db to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:21,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e6acb08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:21,276 DEBUG [hconnection-0x7b1a8e2e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:21,276 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:21,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:21,283 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:21,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62b505db to 127.0.0.1:55155 2023-09-26 04:02:21,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:21,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 04:02:21,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:02:21,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:02:21,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:02:21,288 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:02:21,289 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695701541289 2023-09-26 04:02:21,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:02:21,289 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-26 04:02:21,290 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:02:21,291 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:02:21,292 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:02:21,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 04:02:21,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-26 04:02:21,297 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 04:02:21,297 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695701541297 2023-09-26 04:02:21,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,308 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-26 04:02:21,308 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:21,309 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-26 04:02:21,309 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-26 04:02:21,309 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,309 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,312 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,312 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,312 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,312 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,312 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,312 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,313 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,313 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,314 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,314 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 04:02:21,314 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 04:02:21,314 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:21,314 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 04:02:21,315 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 04:02:21,315 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 04:02:21,314 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:21,315 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 04:02:21,316 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 04:02:21,315 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:21,316 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 04:02:21,316 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 04:02:21,317 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 04:02:21,317 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 04:02:21,317 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 04:02:21,323 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,323 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,324 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,324 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,324 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:21,324 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,324 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,324 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,324 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,324 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,324 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-26 04:02:21,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ea2274e[Count = 1] remaining members to acquire global barrier 2023-09-26 04:02:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-26 04:02:21,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ea2274e[Count = 0] remaining members to acquire global barrier 2023-09-26 04:02:21,327 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-26 04:02:21,327 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,328 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,328 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,328 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,328 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,328 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:02:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,329 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 04:02:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,329 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:02:21,329 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:02:21,329 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,329 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:02:21,329 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:02:21,329 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:21,329 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:21,329 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:21,329 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:21,329 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:21,329 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. started... 2023-09-26 04:02:21,329 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:21,329 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. started... 2023-09-26 04:02:21,330 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e107c0a4104527d21a040381be341d9: 2023-09-26 04:02:21,330 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc4051de02a3799653e5df63fd0d0713: 2023-09-26 04:02:21,331 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 04:02:21,331 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,331 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,331 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:21,331 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:21,331 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:02:21,331 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:21,331 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 04:02:21,332 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:02:21,348 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. completed. 2023-09-26 04:02:21,348 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. completed. 2023-09-26 04:02:21,348 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:21,348 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:21,348 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:21,348 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:21,348 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:21,348 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,348 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:21,348 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 04:02:21,348 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,348 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:02:21,349 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 04:02:21,349 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:02:21,365 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,365 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 04:02:21,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,365 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 04:02:21,365 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:21,365 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,367 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 04:02:21,367 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:21,368 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 04:02:21,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:02:21,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-26 04:02:21,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,43719,1695700858548': 2023-09-26 04:02:21,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-26 04:02:21,373 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-26 04:02:21,373 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:02:21,373 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:02:21,373 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,373 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:02:21,379 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,379 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,379 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,379 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,379 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,379 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,380 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,379 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,380 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,380 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,382 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,382 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,383 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,390 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,390 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,390 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,390 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,390 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:21,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,390 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,390 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,390 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,390 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,392 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-26 04:02:21,392 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:21,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,392 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:02:21,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,392 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,393 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,393 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,393 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,393 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,393 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,393 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 04:02:21,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:02:21,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 04:02:21,393 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:02:21,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,415 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-26 04:02:21,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,415 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695700941289Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695700941399 (+110 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695700941399Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695700941399Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695700941402 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695700941409 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695700941415 (+6 ms) 2023-09-26 04:02:21,418 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 04:02:21,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 128 msec 2023-09-26 04:02:21,593 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:21,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 04:02:21,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:02:21,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34445] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:02:21,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:02:21,607 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-26 04:02:21,607 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:21,607 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:02:21,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:02:21,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700941616 (current time:1695700941616). 2023-09-26 04:02:21,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:02:21,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x40bddfea to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:21,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff9522d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:21,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:21,624 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:21,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40bddfea to 127.0.0.1:55155 2023-09-26 04:02:21,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:21,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x2f0a1172 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:21,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@166d9f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:21,632 DEBUG [hconnection-0x242b8bcd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:21,635 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:21,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:21,642 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:21,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f0a1172 to 127.0.0.1:55155 2023-09-26 04:02:21,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:21,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-26 04:02:21,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:02:21,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:02:21,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:02:21,647 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:02:21,648 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695701541648 2023-09-26 04:02:21,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-26 04:02:21,648 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-26 04:02:21,649 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:02:21,649 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:02:21,650 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-26 04:02:21,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 04:02:21,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-26 04:02:21,652 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 04:02:21,653 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695701541653 2023-09-26 04:02:21,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,663 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-26 04:02:21,664 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:21,665 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-26 04:02:21,665 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-26 04:02:21,666 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,666 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,667 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,667 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,667 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,668 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,668 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,670 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 04:02:21,670 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 04:02:21,670 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:21,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-26 04:02:21,671 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 04:02:21,671 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 04:02:21,671 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 04:02:21,670 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:21,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,672 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 04:02:21,672 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-26 04:02:21,672 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:21,672 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 04:02:21,672 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 04:02:21,675 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-26 04:02:21,675 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-26 04:02:21,675 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-26 04:02:21,679 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,679 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,681 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,681 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,681 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:21,681 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,681 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,681 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,681 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,681 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,681 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-26 04:02:21,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c8a95de[Count = 1] remaining members to acquire global barrier 2023-09-26 04:02:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-26 04:02:21,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c8a95de[Count = 0] remaining members to acquire global barrier 2023-09-26 04:02:21,685 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-26 04:02:21,685 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,685 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,685 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,685 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,685 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,685 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:02:21,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,686 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:02:21,686 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-26 04:02:21,686 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:21,686 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,686 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:21,686 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:21,686 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 04:02:21,686 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:21,686 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:02:21,686 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. started... 2023-09-26 04:02:21,686 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:21,686 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:02:21,686 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:21,686 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. started... 2023-09-26 04:02:21,686 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0e107c0a4104527d21a040381be341d9 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-26 04:02:21,686 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dc4051de02a3799653e5df63fd0d0713 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-26 04:02:21,687 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 04:02:21,687 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:21,687 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 04:02:21,710 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309268c3883bbb5c243938c45f0a8dd4ba45d to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309268c3883bbb5c243938c45f0a8dd4ba45d 2023-09-26 04:02:21,712 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230926f9eae58dd5f6408194a7139354710db1 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230926f9eae58dd5f6408194a7139354710db1 2023-09-26 04:02:21,718 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/.tmp/cf/1dd9b345c5054b078a3115d00b5dd5ec 2023-09-26 04:02:21,721 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/.tmp/cf/bf289e32b22a4202b3b6f9871c3bf937 2023-09-26 04:02:21,723 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/.tmp/cf/1dd9b345c5054b078a3115d00b5dd5ec as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/cf/1dd9b345c5054b078a3115d00b5dd5ec 2023-09-26 04:02:21,728 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/.tmp/cf/bf289e32b22a4202b3b6f9871c3bf937 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/cf/bf289e32b22a4202b3b6f9871c3bf937 2023-09-26 04:02:21,731 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/cf/1dd9b345c5054b078a3115d00b5dd5ec, entries=3, sequenceid=6, filesize=5.4 K 2023-09-26 04:02:21,732 INFO [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0e107c0a4104527d21a040381be341d9 in 46ms, sequenceid=6, compaction requested=false 2023-09-26 04:02:21,732 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-26 04:02:21,733 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e107c0a4104527d21a040381be341d9: 2023-09-26 04:02:21,733 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,734 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:21,734 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/cf/1dd9b345c5054b078a3115d00b5dd5ec] hfiles 2023-09-26 04:02:21,734 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/cf/1dd9b345c5054b078a3115d00b5dd5ec for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,735 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/cf/bf289e32b22a4202b3b6f9871c3bf937, entries=47, sequenceid=6, filesize=13.1 K 2023-09-26 04:02:21,736 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for dc4051de02a3799653e5df63fd0d0713 in 50ms, sequenceid=6, compaction requested=false 2023-09-26 04:02:21,737 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc4051de02a3799653e5df63fd0d0713: 2023-09-26 04:02:21,737 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,737 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:21,737 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/cf/bf289e32b22a4202b3b6f9871c3bf937] hfiles 2023-09-26 04:02:21,737 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/cf/bf289e32b22a4202b3b6f9871c3bf937 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,743 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. completed. 2023-09-26 04:02:21,743 DEBUG [rs(jenkins-hbase20.apache.org,34445,1695700858593)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:21,743 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:21,743 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:21,743 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,746 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 04:02:21,746 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:02:21,747 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,747 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 04:02:21,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,747 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:21,748 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 04:02:21,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,749 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:21,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 04:02:21,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:02:21,751 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:02:21,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,753 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. completed. 2023-09-26 04:02:21,753 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:21,753 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:21,753 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:21,753 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,34445,1695700858593': 2023-09-26 04:02:21,753 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-26 04:02:21,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-26 04:02:21,753 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:02:21,757 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,757 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-26 04:02:21,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,757 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:21,757 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-26 04:02:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,43719,1695700858548': 2023-09-26 04:02:21,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-26 04:02:21,761 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-26 04:02:21,761 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:02:21,761 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:02:21,761 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,761 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:02:21,765 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,765 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,765 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,765 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:21,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,765 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,765 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,766 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:21,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,765 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,766 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,766 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:21,768 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,768 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,768 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:21,771 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:21,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-26 04:02:21,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:21,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,771 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:21,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,773 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:21,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:21,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:02:21,773 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:21,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,773 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:21,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,773 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:21,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230926f9eae58dd5f6408194a7139354710db1, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309268c3883bbb5c243938c45f0a8dd4ba45d] mob files 2023-09-26 04:02:21,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230926f9eae58dd5f6408194a7139354710db1 2023-09-26 04:02:21,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309268c3883bbb5c243938c45f0a8dd4ba45d 2023-09-26 04:02:21,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,803 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-26 04:02:21,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,803 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695700941648Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695700941780 (+132 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695700941780Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695700941780Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695700941785 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695700941794 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695700941803 (+9 ms) 2023-09-26 04:02:21,807 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-26 04:02:21,809 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 159 msec 2023-09-26 04:02:21,951 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:21,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-26 04:02:21,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:02:21,954 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954 2023-09-26 04:02:21,954 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36857, tgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954, rawTgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954, srcFsUri=hdfs://localhost:36857, srcDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:02:21,979 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:02:21,979 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1930850931_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:21,979 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa, snapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-26 04:02:21,983 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:22,005 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,005 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,006 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,006 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,707 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-2255654918667711915.jar 2023-09-26 04:02:22,708 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,708 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,761 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-7685403421814895716.jar 2023-09-26 04:02:22,761 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,761 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,761 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,762 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,762 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,762 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:22,763 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 04:02:22,763 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 04:02:22,763 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 04:02:22,763 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 04:02:22,764 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 04:02:22,764 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 04:02:22,764 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 04:02:22,765 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 04:02:22,765 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 04:02:22,765 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 04:02:22,766 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:22,766 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:22,766 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:02:22,766 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:22,767 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:22,767 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:02:22,767 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:02:23,119 WARN [Listener at jenkins-hbase20.apache.org/39825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 04:02:23,121 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-26 04:02:24,759 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:02:24,759 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:02:24,764 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0005_000001 (auth:SIMPLE) 2023-09-26 04:02:25,218 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0006_000001 (auth:SIMPLE) 2023-09-26 04:02:25,431 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 04:02:28,535 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0006_000001 (auth:SIMPLE) 2023-09-26 04:02:31,478 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 04:02:31,478 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 04:02:31,483 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:31,483 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 04:02:31,484 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 04:02:31,484 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:31,484 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-26 04:02:31,484 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-26 04:02:31,484 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:31,485 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-26 04:02:31,485 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700941954/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-26 04:02:31,489 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-26 04:02:31,493 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700951493"}]},"ts":"1695700951493"} 2023-09-26 04:02:31,495 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-26 04:02:31,496 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-26 04:02:31,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e107c0a4104527d21a040381be341d9, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc4051de02a3799653e5df63fd0d0713, UNASSIGN}] 2023-09-26 04:02:31,498 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e107c0a4104527d21a040381be341d9, UNASSIGN 2023-09-26 04:02:31,498 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc4051de02a3799653e5df63fd0d0713, UNASSIGN 2023-09-26 04:02:31,499 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0e107c0a4104527d21a040381be341d9, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:31,499 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=dc4051de02a3799653e5df63fd0d0713, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:31,499 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700951499"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700951499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700951499"}]},"ts":"1695700951499"} 2023-09-26 04:02:31,500 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700951499"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700951499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700951499"}]},"ts":"1695700951499"} 2023-09-26 04:02:31,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 0e107c0a4104527d21a040381be341d9, server=jenkins-hbase20.apache.org,34445,1695700858593}] 2023-09-26 04:02:31,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure dc4051de02a3799653e5df63fd0d0713, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:02:31,535 WARN [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(706): Expected HEADER=HBas but received HEADER=\x04\x01\x00P from 103.156.91.88:59532 2023-09-26 04:02:31,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-26 04:02:31,637 WARN [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(706): Expected HEADER=HBas but received HEADER=\x04\x01\x00P from 103.156.91.88:59556 2023-09-26 04:02:31,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:31,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0e107c0a4104527d21a040381be341d9, disabling compactions & flushes 2023-09-26 04:02:31,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:31,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:31,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. after waiting 0 ms 2023-09-26 04:02:31,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:31,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:31,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing dc4051de02a3799653e5df63fd0d0713, disabling compactions & flushes 2023-09-26 04:02:31,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:31,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:31,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. after waiting 0 ms 2023-09-26 04:02:31,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:31,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:02:31,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:02:31,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:31,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:31,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9. 2023-09-26 04:02:31,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0e107c0a4104527d21a040381be341d9: 2023-09-26 04:02:31,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713. 2023-09-26 04:02:31,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for dc4051de02a3799653e5df63fd0d0713: 2023-09-26 04:02:31,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:31,664 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=dc4051de02a3799653e5df63fd0d0713, regionState=CLOSED 2023-09-26 04:02:31,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:31,665 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700951664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700951664"}]},"ts":"1695700951664"} 2023-09-26 04:02:31,665 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0e107c0a4104527d21a040381be341d9, regionState=CLOSED 2023-09-26 04:02:31,665 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695700951665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700951665"}]},"ts":"1695700951665"} 2023-09-26 04:02:31,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-26 04:02:31,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure dc4051de02a3799653e5df63fd0d0713, server=jenkins-hbase20.apache.org,43719,1695700858548 in 164 msec 2023-09-26 04:02:31,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-26 04:02:31,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 0e107c0a4104527d21a040381be341d9, server=jenkins-hbase20.apache.org,34445,1695700858593 in 166 msec 2023-09-26 04:02:31,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc4051de02a3799653e5df63fd0d0713, UNASSIGN in 171 msec 2023-09-26 04:02:31,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-26 04:02:31,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e107c0a4104527d21a040381be341d9, UNASSIGN in 172 msec 2023-09-26 04:02:31,670 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700951669"}]},"ts":"1695700951669"} 2023-09-26 04:02:31,671 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-26 04:02:31,672 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-26 04:02:31,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 182 msec 2023-09-26 04:02:31,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-26 04:02:31,796 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-26 04:02:31,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,800 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,800 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,801 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,803 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,803 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,803 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,803 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-26 04:02:31,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-26 04:02:31,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-26 04:02:31,804 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,804 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,804 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:31,804 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:31,804 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,804 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:31,804 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:31,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-09-26 04:02:31,804 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-26 04:02:31,805 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:31,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-26 04:02:31,805 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:31,806 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/recovered.edits] 2023-09-26 04:02:31,806 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/recovered.edits] 2023-09-26 04:02:31,809 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/cf/bf289e32b22a4202b3b6f9871c3bf937 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/cf/bf289e32b22a4202b3b6f9871c3bf937 2023-09-26 04:02:31,809 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/cf/1dd9b345c5054b078a3115d00b5dd5ec to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/cf/1dd9b345c5054b078a3115d00b5dd5ec 2023-09-26 04:02:31,812 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713/recovered.edits/9.seqid 2023-09-26 04:02:31,812 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9/recovered.edits/9.seqid 2023-09-26 04:02:31,812 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e107c0a4104527d21a040381be341d9 2023-09-26 04:02:31,812 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc4051de02a3799653e5df63fd0d0713 2023-09-26 04:02:31,812 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-26 04:02:31,813 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-26 04:02:31,813 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-26 04:02:31,816 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230926f9eae58dd5f6408194a7139354710db1 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230926f9eae58dd5f6408194a7139354710db1 2023-09-26 04:02:31,817 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309268c3883bbb5c243938c45f0a8dd4ba45d to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309268c3883bbb5c243938c45f0a8dd4ba45d 2023-09-26 04:02:31,817 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-26 04:02:31,818 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,820 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-26 04:02:31,822 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-26 04:02:31,823 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,823 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-26 04:02:31,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700951823"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:31,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700951823"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:31,825 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 04:02:31,825 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0e107c0a4104527d21a040381be341d9, NAME => 'testtb-testEmptyExportFileSystemState,,1695700940609.0e107c0a4104527d21a040381be341d9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dc4051de02a3799653e5df63fd0d0713, NAME => 'testtb-testEmptyExportFileSystemState,1,1695700940609.dc4051de02a3799653e5df63fd0d0713.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 04:02:31,825 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-26 04:02:31,825 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695700951825"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:31,826 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-26 04:02:31,840 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-26 04:02:31,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 43 msec 2023-09-26 04:02:31,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-26 04:02:31,906 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-26 04:02:31,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-26 04:02:31,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:31,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-26 04:02:31,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-26 04:02:31,941 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 763) Potentially hanging thread: hconnection-0x6d03649-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1399679715_1 at /127.0.0.1:55660 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:44862 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:55698 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1542791596) connection to jenkins-hbase20.apache.org/148.251.75.209:42219 from appattempt_1695700864748_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-996147106_17 at /127.0.0.1:38632 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1542791596) connection to jenkins-hbase20.apache.org/148.251.75.209:40419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1399679715_1 at /127.0.0.1:38622 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d03649-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4721 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=951 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=119 (was 124), ProcessCount=167 (was 167), AvailableMemoryMB=7357 (was 7433) 2023-09-26 04:02:31,941 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-26 04:02:31,957 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=951, MaxFileDescriptor=60000, SystemLoadAverage=119, ProcessCount=167, AvailableMemoryMB=7357 2023-09-26 04:02:31,957 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-26 04:02:31,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-26 04:02:31,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:31,962 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-26 04:02:31,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-26 04:02:31,962 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-26 04:02:31,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-26 04:02:31,964 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:31,964 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:31,965 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf empty. 2023-09-26 04:02:31,965 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d empty. 2023-09-26 04:02:31,965 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:31,965 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:31,965 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-26 04:02:31,977 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-26 04:02:31,978 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => a0cbc65c7cfc6f55bef4bf3ba56f107d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:02:31,978 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => bb359a66725c431814ec2a61413d9cdf, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp 2023-09-26 04:02:31,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:31,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing a0cbc65c7cfc6f55bef4bf3ba56f107d, disabling compactions & flushes 2023-09-26 04:02:31,995 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:31,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:31,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. after waiting 0 ms 2023-09-26 04:02:31,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:31,995 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:31,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for a0cbc65c7cfc6f55bef4bf3ba56f107d: 2023-09-26 04:02:31,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:31,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing bb359a66725c431814ec2a61413d9cdf, disabling compactions & flushes 2023-09-26 04:02:31,997 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:31,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:31,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. after waiting 0 ms 2023-09-26 04:02:31,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:31,997 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:31,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for bb359a66725c431814ec2a61413d9cdf: 2023-09-26 04:02:31,999 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-26 04:02:32,000 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700952000"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700952000"}]},"ts":"1695700952000"} 2023-09-26 04:02:32,000 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700952000"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700952000"}]},"ts":"1695700952000"} 2023-09-26 04:02:32,008 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-26 04:02:32,009 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-26 04:02:32,009 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700952009"}]},"ts":"1695700952009"} 2023-09-26 04:02:32,010 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-26 04:02:32,012 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-26 04:02:32,013 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-26 04:02:32,013 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-26 04:02:32,013 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-26 04:02:32,013 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-26 04:02:32,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0cbc65c7cfc6f55bef4bf3ba56f107d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb359a66725c431814ec2a61413d9cdf, ASSIGN}] 2023-09-26 04:02:32,016 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb359a66725c431814ec2a61413d9cdf, ASSIGN 2023-09-26 04:02:32,016 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0cbc65c7cfc6f55bef4bf3ba56f107d, ASSIGN 2023-09-26 04:02:32,016 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb359a66725c431814ec2a61413d9cdf, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44553,1695700858629; forceNewPlan=false, retain=false 2023-09-26 04:02:32,016 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0cbc65c7cfc6f55bef4bf3ba56f107d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43719,1695700858548; forceNewPlan=false, retain=false 2023-09-26 04:02:32,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-26 04:02:32,167 INFO [jenkins-hbase20:38025] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-26 04:02:32,172 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bb359a66725c431814ec2a61413d9cdf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,172 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a0cbc65c7cfc6f55bef4bf3ba56f107d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,172 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700952171"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700952171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700952171"}]},"ts":"1695700952171"} 2023-09-26 04:02:32,172 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700952172"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700952172"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700952172"}]},"ts":"1695700952172"} 2023-09-26 04:02:32,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure bb359a66725c431814ec2a61413d9cdf, server=jenkins-hbase20.apache.org,44553,1695700858629}] 2023-09-26 04:02:32,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure a0cbc65c7cfc6f55bef4bf3ba56f107d, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:02:32,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-26 04:02:32,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:32,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:32,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb359a66725c431814ec2a61413d9cdf, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.', STARTKEY => '1', ENDKEY => ''} 2023-09-26 04:02:32,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0cbc65c7cfc6f55bef4bf3ba56f107d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.', STARTKEY => '', ENDKEY => '1'} 2023-09-26 04:02:32,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. service=AccessControlService 2023-09-26 04:02:32,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. service=AccessControlService 2023-09-26 04:02:32,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:02:32,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-26 04:02:32,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:32,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:32,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:32,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:32,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:32,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-26 04:02:32,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:32,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:32,341 INFO [StoreOpener-bb359a66725c431814ec2a61413d9cdf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:32,341 INFO [StoreOpener-a0cbc65c7cfc6f55bef4bf3ba56f107d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:32,342 DEBUG [StoreOpener-bb359a66725c431814ec2a61413d9cdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/cf 2023-09-26 04:02:32,342 DEBUG [StoreOpener-a0cbc65c7cfc6f55bef4bf3ba56f107d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/cf 2023-09-26 04:02:32,343 DEBUG [StoreOpener-a0cbc65c7cfc6f55bef4bf3ba56f107d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/cf 2023-09-26 04:02:32,342 DEBUG [StoreOpener-bb359a66725c431814ec2a61413d9cdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/cf 2023-09-26 04:02:32,343 INFO [StoreOpener-a0cbc65c7cfc6f55bef4bf3ba56f107d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0cbc65c7cfc6f55bef4bf3ba56f107d columnFamilyName cf 2023-09-26 04:02:32,343 INFO [StoreOpener-bb359a66725c431814ec2a61413d9cdf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb359a66725c431814ec2a61413d9cdf columnFamilyName cf 2023-09-26 04:02:32,344 INFO [StoreOpener-bb359a66725c431814ec2a61413d9cdf-1] regionserver.HStore(310): Store=bb359a66725c431814ec2a61413d9cdf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:02:32,344 INFO [StoreOpener-a0cbc65c7cfc6f55bef4bf3ba56f107d-1] regionserver.HStore(310): Store=a0cbc65c7cfc6f55bef4bf3ba56f107d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-26 04:02:32,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:32,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:32,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:32,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:32,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:32,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:32,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:02:32,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-26 04:02:32,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bb359a66725c431814ec2a61413d9cdf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72699315, jitterRate=0.08330421149730682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:02:32,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bb359a66725c431814ec2a61413d9cdf: 2023-09-26 04:02:32,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a0cbc65c7cfc6f55bef4bf3ba56f107d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62506251, jitterRate=-0.06858427822589874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-26 04:02:32,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a0cbc65c7cfc6f55bef4bf3ba56f107d: 2023-09-26 04:02:32,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf., pid=108, masterSystemTime=1695700952328 2023-09-26 04:02:32,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d., pid=109, masterSystemTime=1695700952328 2023-09-26 04:02:32,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:32,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:32,351 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a0cbc65c7cfc6f55bef4bf3ba56f107d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:32,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:32,353 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700952351"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700952351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700952351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700952351"}]},"ts":"1695700952351"} 2023-09-26 04:02:32,354 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bb359a66725c431814ec2a61413d9cdf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,354 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700952353"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695700952353"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695700952353"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695700952353"}]},"ts":"1695700952353"} 2023-09-26 04:02:32,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-26 04:02:32,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure a0cbc65c7cfc6f55bef4bf3ba56f107d, server=jenkins-hbase20.apache.org,43719,1695700858548 in 178 msec 2023-09-26 04:02:32,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-26 04:02:32,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure bb359a66725c431814ec2a61413d9cdf, server=jenkins-hbase20.apache.org,44553,1695700858629 in 179 msec 2023-09-26 04:02:32,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0cbc65c7cfc6f55bef4bf3ba56f107d, ASSIGN in 343 msec 2023-09-26 04:02:32,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-26 04:02:32,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb359a66725c431814ec2a61413d9cdf, ASSIGN in 344 msec 2023-09-26 04:02:32,359 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-26 04:02:32,359 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700952359"}]},"ts":"1695700952359"} 2023-09-26 04:02:32,360 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-26 04:02:32,362 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-26 04:02:32,362 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-26 04:02:32,364 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-26 04:02:32,365 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:32,365 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:32,365 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:32,365 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:32,366 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:32,366 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:32,366 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:32,366 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-26 04:02:32,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 407 msec 2023-09-26 04:02:32,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-26 04:02:32,570 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-26 04:02:32,575 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,576 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:32,579 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:02:32,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 04:02:32,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700952596 (current time:1695700952596). 2023-09-26 04:02:32,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:02:32,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x34cc2a87 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:32,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57cb1719, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:32,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:32,605 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:32,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34cc2a87 to 127.0.0.1:55155 2023-09-26 04:02:32,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:32,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x50aec84b to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:32,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e348cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:32,623 DEBUG [hconnection-0xa1ff4b1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:32,633 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:32,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:32,641 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:32,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50aec84b to 127.0.0.1:55155 2023-09-26 04:02:32,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:32,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-26 04:02:32,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:02:32,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 04:02:32,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 04:02:32,646 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 04:02:32,646 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695701552646 2023-09-26 04:02:32,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 04:02:32,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,648 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:02:32,648 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:02:32,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 04:02:32,649 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 04:02:32,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-26 04:02:32,652 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 04:02:32,652 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695701552652 2023-09-26 04:02:32,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,664 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-26 04:02:32,664 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:32,665 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-26 04:02:32,665 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-26 04:02:32,665 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,665 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,667 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:32,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:32,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:32,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:32,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:32,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:32,668 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,668 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,668 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,668 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:02:32,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,669 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 04:02:32,669 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 04:02:32,669 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,670 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 04:02:32,670 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 04:02:32,669 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:32,670 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:32,670 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 04:02:32,672 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 04:02:32,672 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 04:02:32,671 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 04:02:32,672 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 04:02:32,672 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 04:02:32,672 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 04:02:32,672 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 04:02:32,673 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,673 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,673 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,673 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,673 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,674 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:32,674 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:32,674 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,674 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,674 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:32,674 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:32,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-26 04:02:32,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c98f3f4[Count = 1] remaining members to acquire global barrier 2023-09-26 04:02:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:32,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-26 04:02:32,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c98f3f4[Count = 0] remaining members to acquire global barrier 2023-09-26 04:02:32,678 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-26 04:02:32,678 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,687 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,688 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,687 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,688 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 04:02:32,688 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,688 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 04:02:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,688 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:02:32,688 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 04:02:32,688 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,688 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:02:32,688 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 04:02:32,688 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:32,688 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:32,688 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:32,688 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:32,688 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:32,688 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:32,688 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. started... 2023-09-26 04:02:32,688 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. started... 2023-09-26 04:02:32,689 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0cbc65c7cfc6f55bef4bf3ba56f107d: 2023-09-26 04:02:32,690 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb359a66725c431814ec2a61413d9cdf: 2023-09-26 04:02:32,690 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,690 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:32,690 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,690 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:02:32,690 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:32,690 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-26 04:02:32,693 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 04:02:32,693 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:32,693 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 04:02:32,711 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. completed. 2023-09-26 04:02:32,711 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:32,711 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:32,711 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:32,711 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,711 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. completed. 2023-09-26 04:02:32,711 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 04:02:32,711 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:02:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 04:02:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:02:32,720 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,721 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 04:02:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:32,721 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 04:02:32,721 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:32,721 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,721 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 04:02:32,721 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:32,722 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 04:02:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44553,1695700858629': 2023-09-26 04:02:32,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-26 04:02:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,43719,1695700858548': 2023-09-26 04:02:32,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-26 04:02:32,728 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-26 04:02:32,728 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:02:32,728 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:02:32,728 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,728 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:02:32,729 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,729 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,729 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:32,729 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,729 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,729 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,729 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:32,730 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:32,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:32,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,730 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,730 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:32,731 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,732 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,732 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,733 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,733 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:32,734 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:32,733 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:32,734 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:32,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:32,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,734 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:32,734 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:32,734 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:32,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,735 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:32,735 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:32,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:32,735 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:32,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:02:32,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:32,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:32,735 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,736 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:32,736 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,736 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:32,736 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:32,736 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,736 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-26 04:02:32,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,748 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:32,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-26 04:02:32,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:02:32,749 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:02:32,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-26 04:02:32,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,765 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695700952646Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695700952743 (+97 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695700952743Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695700952743Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695700952748 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695700952759 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695700952764 (+5 ms) 2023-09-26 04:02:32,767 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 04:02:32,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 120 msec 2023-09-26 04:02:32,949 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:32,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-26 04:02:32,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:02:32,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:02:32,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44553] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. with WAL disabled. Data may be lost in the event of a crash. 2023-09-26 04:02:32,962 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:32,962 DEBUG [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:32,962 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-26 04:02:32,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 04:02:32,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695700952971 (current time:1695700952971). 2023-09-26 04:02:32,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-26 04:02:32,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x0fd4fe85 to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:32,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a9b29b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:32,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:32,980 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:32,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fd4fe85 to 127.0.0.1:55155 2023-09-26 04:02:32,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:32,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(139): Connect 0x0ff4b3da to 127.0.0.1:55155 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-26 04:02:32,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27fc4477, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-26 04:02:32,990 DEBUG [hconnection-0x4892f83-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:32,991 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:32,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-26 04:02:32,997 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-26 04:02:32,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ff4b3da to 127.0.0.1:55155 2023-09-26 04:02:32,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:02:32,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-26 04:02:32,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-26 04:02:32,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 04:02:33,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 04:02:33,002 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 04:02:33,003 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695701553003 2023-09-26 04:02:33,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-26 04:02:33,003 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,005 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-26 04:02:33,005 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-26 04:02:33,006 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-26 04:02:33,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 04:02:33,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-26 04:02:33,008 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 04:02:33,009 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695701553009 2023-09-26 04:02:33,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,020 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-26 04:02:33,020 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:33,021 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-26 04:02:33,021 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-26 04:02:33,021 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,021 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,022 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:33,022 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:33,022 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:33,022 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:33,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:33,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:33,022 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,022 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:33,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,023 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,023 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 04:02:33,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-26 04:02:33,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,024 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 04:02:33,024 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 04:02:33,024 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:33,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,025 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 04:02:33,025 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-26 04:02:33,025 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:33,024 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-26 04:02:33,025 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 04:02:33,026 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 04:02:33,025 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 04:02:33,026 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 04:02:33,026 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 04:02:33,026 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-26 04:02:33,026 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-26 04:02:33,026 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34445,1695700858593' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-26 04:02:33,029 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,029 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:33,030 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,030 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,030 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:33,030 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,030 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:33,030 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,030 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:33,030 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,030 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-26 04:02:33,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:33,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:33,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43719,1695700858548' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-26 04:02:33,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ad34d0b[Count = 1] remaining members to acquire global barrier 2023-09-26 04:02:33,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:33,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:33,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:33,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:33,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:33,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44553,1695700858629' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-26 04:02:33,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ad34d0b[Count = 0] remaining members to acquire global barrier 2023-09-26 04:02:33,034 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-26 04:02:33,034 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,040 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,040 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,040 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,040 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 04:02:33,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,040 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,041 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:33,041 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 04:02:33,040 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:33,041 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 04:02:33,041 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. started... 2023-09-26 04:02:33,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,041 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,041 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-26 04:02:33,041 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a0cbc65c7cfc6f55bef4bf3ba56f107d 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-26 04:02:33,041 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,34445,1695700858593' in zk 2023-09-26 04:02:33,041 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:33,041 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-26 04:02:33,041 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-26 04:02:33,041 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-26 04:02:33,041 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:33,042 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. started... 2023-09-26 04:02:33,042 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bb359a66725c431814ec2a61413d9cdf 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-26 04:02:33,042 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 04:02:33,043 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:33,043 DEBUG [member: 'jenkins-hbase20.apache.org,34445,1695700858593' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 04:02:33,063 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092638a6dac0f29e4120af1536ab43b4e9be to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092638a6dac0f29e4120af1536ab43b4e9be 2023-09-26 04:02:33,068 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230926a3cf4ec402574be0b4208d621b99e0dd to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926a3cf4ec402574be0b4208d621b99e0dd 2023-09-26 04:02:33,069 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/.tmp/cf/da2086b8859f43c3892720579f275e8b 2023-09-26 04:02:33,074 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/.tmp/cf/da2086b8859f43c3892720579f275e8b as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/cf/da2086b8859f43c3892720579f275e8b 2023-09-26 04:02:33,075 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/.tmp/cf/98665296439b4b58bf77778ab241e8a2 2023-09-26 04:02:33,078 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/cf/da2086b8859f43c3892720579f275e8b, entries=1, sequenceid=6, filesize=5.1 K 2023-09-26 04:02:33,079 INFO [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for a0cbc65c7cfc6f55bef4bf3ba56f107d in 38ms, sequenceid=6, compaction requested=false 2023-09-26 04:02:33,079 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-26 04:02:33,080 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/.tmp/cf/98665296439b4b58bf77778ab241e8a2 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/cf/98665296439b4b58bf77778ab241e8a2 2023-09-26 04:02:33,080 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0cbc65c7cfc6f55bef4bf3ba56f107d: 2023-09-26 04:02:33,080 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,080 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:33,081 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/cf/da2086b8859f43c3892720579f275e8b] hfiles 2023-09-26 04:02:33,081 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/cf/da2086b8859f43c3892720579f275e8b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,085 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/cf/98665296439b4b58bf77778ab241e8a2, entries=49, sequenceid=6, filesize=13.7 K 2023-09-26 04:02:33,085 INFO [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for bb359a66725c431814ec2a61413d9cdf in 43ms, sequenceid=6, compaction requested=false 2023-09-26 04:02:33,087 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb359a66725c431814ec2a61413d9cdf: 2023-09-26 04:02:33,087 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,087 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-26 04:02:33,087 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/cf/98665296439b4b58bf77778ab241e8a2] hfiles 2023-09-26 04:02:33,087 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/cf/98665296439b4b58bf77778ab241e8a2 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,089 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. completed. 2023-09-26 04:02:33,089 DEBUG [rs(jenkins-hbase20.apache.org,43719,1695700858548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:33,089 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:33,089 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:33,089 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,089 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 04:02:33,089 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,43719,1695700858548' in zk 2023-09-26 04:02:33,090 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,090 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 04:02:33,090 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:33,091 DEBUG [member: 'jenkins-hbase20.apache.org,43719,1695700858548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 04:02:33,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,43719,1695700858548': 2023-09-26 04:02:33,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43719,1695700858548' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-26 04:02:33,095 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. completed. 2023-09-26 04:02:33,095 DEBUG [rs(jenkins-hbase20.apache.org,44553,1695700858629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:33,095 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-26 04:02:33,095 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-26 04:02:33,095 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,095 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-26 04:02:33,095 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44553,1695700858629' in zk 2023-09-26 04:02:33,104 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-26 04:02:33,104 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,104 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:33,104 DEBUG [member: 'jenkins-hbase20.apache.org,44553,1695700858629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-26 04:02:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:33,105 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:33,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:33,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:33,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-26 04:02:33,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-26 04:02:33,107 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-26 04:02:33,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:33,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44553,1695700858629': 2023-09-26 04:02:33,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44553,1695700858629' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-26 04:02:33,109 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-26 04:02:33,109 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-26 04:02:33,109 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-26 04:02:33,109 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,109 INFO [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-26 04:02:33,110 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,110 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,110 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,110 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:33,110 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,110 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,111 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:33,111 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,111 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,112 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-26 04:02:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,113 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,113 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-26 04:02:33,113 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-26 04:02:33,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:33,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:33,115 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,115 DEBUG [(jenkins-hbase20.apache.org,38025,1695700857519)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-26 04:02:33,115 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:33,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-26 04:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-26 04:02:33,115 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-26 04:02:33,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:33,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-26 04:02:33,116 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:33,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:33,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-26 04:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:33,117 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:33,117 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-26 04:02:33,117 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926a3cf4ec402574be0b4208d621b99e0dd, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092638a6dac0f29e4120af1536ab43b4e9be] mob files 2023-09-26 04:02:33,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926a3cf4ec402574be0b4208d621b99e0dd 2023-09-26 04:02:33,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092638a6dac0f29e4120af1536ab43b4e9be 2023-09-26 04:02:33,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-26 04:02:33,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,139 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695700953003Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695700953122 (+119 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695700953122Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695700953123 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695700953125 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695700953132 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695700953138 (+6 ms) 2023-09-26 04:02:33,140 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-26 04:02:33,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 136 msec 2023-09-26 04:02:33,307 DEBUG [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-26 04:02:33,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-26 04:02:33,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-26 04:02:33,309 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309 2023-09-26 04:02:33,309 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36857, tgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309, rawTgtDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309, srcFsUri=hdfs://localhost:36857, srcDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:02:33,332 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa 2023-09-26 04:02:33,333 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-140725925_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,333 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36857, inputRoot=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa, snapshotDir=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-26 04:02:33,343 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:33,368 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:33,369 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:33,369 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:33,370 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:34,073 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-1519291223003180152.jar 2023-09-26 04:02:34,073 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:34,073 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:34,126 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/hadoop-7299864821992944900.jar 2023-09-26 04:02:34,127 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:34,127 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:34,127 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:34,128 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:34,128 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:34,128 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-26 04:02:34,129 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-26 04:02:34,129 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-26 04:02:34,129 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-26 04:02:34,129 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-26 04:02:34,130 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-26 04:02:34,130 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-26 04:02:34,130 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-26 04:02:34,131 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-26 04:02:34,131 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-26 04:02:34,131 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-26 04:02:34,132 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:34,132 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:34,132 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:02:34,132 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:34,133 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-26 04:02:34,133 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:02:34,133 DEBUG [Listener at jenkins-hbase20.apache.org/39825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-26 04:02:34,491 WARN [Listener at jenkins-hbase20.apache.org/39825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-26 04:02:34,493 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-26 04:02:34,495 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-26 04:02:35,842 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:02:35,842 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-26 04:02:35,848 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0006_000001 (auth:SIMPLE) 2023-09-26 04:02:36,771 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0007_000001 (auth:SIMPLE) 2023-09-26 04:02:37,240 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 04:02:40,140 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0007_000001 (auth:SIMPLE) 2023-09-26 04:02:42,329 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0007_000001 (auth:SIMPLE) 2023-09-26 04:02:44,472 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0007_000001 (auth:SIMPLE) 2023-09-26 04:02:45,689 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-26 04:02:45,689 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-26 04:02:45,698 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:45,698 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-26 04:02:45,699 INFO [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-26 04:02:45,699 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:45,699 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-26 04:02:45,699 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-26 04:02:45,699 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-996147106_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:45,700 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-26 04:02:45,700 DEBUG [Listener at jenkins-hbase20.apache.org/39825] snapshot.TestExportSnapshot(367): hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/export-test/export-1695700953309/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-26 04:02:45,711 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:45,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:45,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:45,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-26 04:02:45,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700965715"}]},"ts":"1695700965715"} 2023-09-26 04:02:45,716 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-26 04:02:45,717 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-26 04:02:45,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0cbc65c7cfc6f55bef4bf3ba56f107d, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb359a66725c431814ec2a61413d9cdf, UNASSIGN}] 2023-09-26 04:02:45,720 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0cbc65c7cfc6f55bef4bf3ba56f107d, UNASSIGN 2023-09-26 04:02:45,720 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb359a66725c431814ec2a61413d9cdf, UNASSIGN 2023-09-26 04:02:45,720 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=bb359a66725c431814ec2a61413d9cdf, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:02:45,720 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a0cbc65c7cfc6f55bef4bf3ba56f107d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:02:45,720 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700965720"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700965720"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700965720"}]},"ts":"1695700965720"} 2023-09-26 04:02:45,720 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700965720"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695700965720"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695700965720"}]},"ts":"1695700965720"} 2023-09-26 04:02:45,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure bb359a66725c431814ec2a61413d9cdf, server=jenkins-hbase20.apache.org,44553,1695700858629}] 2023-09-26 04:02:45,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure a0cbc65c7cfc6f55bef4bf3ba56f107d, server=jenkins-hbase20.apache.org,43719,1695700858548}] 2023-09-26 04:02:45,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-26 04:02:45,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:45,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bb359a66725c431814ec2a61413d9cdf, disabling compactions & flushes 2023-09-26 04:02:45,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:45,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:45,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. after waiting 0 ms 2023-09-26 04:02:45,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:45,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:45,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a0cbc65c7cfc6f55bef4bf3ba56f107d, disabling compactions & flushes 2023-09-26 04:02:45,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:45,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:45,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. after waiting 0 ms 2023-09-26 04:02:45,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:45,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:02:45,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:02:45,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:45,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:02:45,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d. 2023-09-26 04:02:45,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf. 2023-09-26 04:02:45,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a0cbc65c7cfc6f55bef4bf3ba56f107d: 2023-09-26 04:02:45,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bb359a66725c431814ec2a61413d9cdf: 2023-09-26 04:02:45,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:45,894 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a0cbc65c7cfc6f55bef4bf3ba56f107d, regionState=CLOSED 2023-09-26 04:02:45,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:45,894 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700965894"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700965894"}]},"ts":"1695700965894"} 2023-09-26 04:02:45,894 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=bb359a66725c431814ec2a61413d9cdf, regionState=CLOSED 2023-09-26 04:02:45,894 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695700965894"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695700965894"}]},"ts":"1695700965894"} 2023-09-26 04:02:45,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-26 04:02:45,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure a0cbc65c7cfc6f55bef4bf3ba56f107d, server=jenkins-hbase20.apache.org,43719,1695700858548 in 172 msec 2023-09-26 04:02:45,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-26 04:02:45,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure bb359a66725c431814ec2a61413d9cdf, server=jenkins-hbase20.apache.org,44553,1695700858629 in 174 msec 2023-09-26 04:02:45,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0cbc65c7cfc6f55bef4bf3ba56f107d, UNASSIGN in 179 msec 2023-09-26 04:02:45,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-26 04:02:45,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb359a66725c431814ec2a61413d9cdf, UNASSIGN in 179 msec 2023-09-26 04:02:45,899 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695700965899"}]},"ts":"1695700965899"} 2023-09-26 04:02:45,900 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-26 04:02:45,989 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-26 04:02:45,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 280 msec 2023-09-26 04:02:46,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-26 04:02:46,019 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-26 04:02:46,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,027 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,028 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,030 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34445] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,033 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:46,033 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:46,035 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/recovered.edits] 2023-09-26 04:02:46,035 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/cf, FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/recovered.edits] 2023-09-26 04:02:46,039 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/cf/da2086b8859f43c3892720579f275e8b to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/cf/da2086b8859f43c3892720579f275e8b 2023-09-26 04:02:46,039 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/cf/98665296439b4b58bf77778ab241e8a2 to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/cf/98665296439b4b58bf77778ab241e8a2 2023-09-26 04:02:46,041 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d/recovered.edits/9.seqid 2023-09-26 04:02:46,041 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/recovered.edits/9.seqid to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf/recovered.edits/9.seqid 2023-09-26 04:02:46,042 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0cbc65c7cfc6f55bef4bf3ba56f107d 2023-09-26 04:02:46,042 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb359a66725c431814ec2a61413d9cdf 2023-09-26 04:02:46,042 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-26 04:02:46,042 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-26 04:02:46,043 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-26 04:02:46,045 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926a3cf4ec402574be0b4208d621b99e0dd to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230926a3cf4ec402574be0b4208d621b99e0dd 2023-09-26 04:02:46,046 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092638a6dac0f29e4120af1536ab43b4e9be to hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092638a6dac0f29e4120af1536ab43b4e9be 2023-09-26 04:02:46,046 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-26 04:02:46,048 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,050 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-26 04:02:46,051 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-26 04:02:46,052 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,052 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-26 04:02:46,052 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700966052"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:46,053 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695700966052"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:46,054 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-26 04:02:46,054 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a0cbc65c7cfc6f55bef4bf3ba56f107d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695700951958.a0cbc65c7cfc6f55bef4bf3ba56f107d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bb359a66725c431814ec2a61413d9cdf, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695700951958.bb359a66725c431814ec2a61413d9cdf.', STARTKEY => '1', ENDKEY => ''}] 2023-09-26 04:02:46,054 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-26 04:02:46,054 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695700966054"}]},"ts":"9223372036854775807"} 2023-09-26 04:02:46,055 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-26 04:02:46,073 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,073 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,073 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,073 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,074 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-26 04:02:46,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-26 04:02:46,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-26 04:02:46,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-26 04:02:46,074 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,074 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,074 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,074 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:46,074 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,074 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:46,074 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:46,075 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-26 04:02:46,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 53 msec 2023-09-26 04:02:46,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-26 04:02:46,076 INFO [Listener at jenkins-hbase20.apache.org/39825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-26 04:02:46,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-26 04:02:46,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-26 04:02:46,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38025] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-26 04:02:46,109 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 766), OpenFileDescriptor=913 (was 951), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=109 (was 119), ProcessCount=167 (was 167), AvailableMemoryMB=7286 (was 7357) 2023-09-26 04:02:46,109 WARN [Listener at jenkins-hbase20.apache.org/39825] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-26 04:02:46,109 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-26 04:02:46,121 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-26 04:02:50,739 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695700864748_0007_000001 (auth:SIMPLE) 2023-09-26 04:02:51,478 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-26 04:03:00,263 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-26 04:03:14,389 ERROR [Thread[Thread-407,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-26 04:03:14,390 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-26 04:03:14,504 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-26 04:03:14,511 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-26 04:03:14,513 ERROR [Thread[Thread-417,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-26 04:03:14,520 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-26 04:03:14,625 ERROR [Thread[Thread-382,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-26 04:03:14,625 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-26 04:03:14,625 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-26 04:03:14,625 INFO [Listener at jenkins-hbase20.apache.org/39825] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-26 04:03:14,626 DEBUG [Listener at jenkins-hbase20.apache.org/39825] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4423e4e4 to 127.0.0.1:55155 2023-09-26 04:03:14,626 DEBUG [Listener at jenkins-hbase20.apache.org/39825] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:03:14,626 DEBUG [Listener at jenkins-hbase20.apache.org/39825] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-26 04:03:14,626 DEBUG [Listener at jenkins-hbase20.apache.org/39825] util.JVMClusterUtil(257): Found active master hash=250209000, stopped=false 2023-09-26 04:03:14,627 DEBUG [Listener at jenkins-hbase20.apache.org/39825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:03:14,627 DEBUG [Listener at jenkins-hbase20.apache.org/39825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-26 04:03:14,627 INFO [Listener at jenkins-hbase20.apache.org/39825] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:03:14,628 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-26 04:03:14,628 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-26 04:03:14,629 INFO [Listener at jenkins-hbase20.apache.org/39825] procedure2.ProcedureExecutor(628): Stopping 2023-09-26 04:03:14,629 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:03:14,628 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-26 04:03:14,629 DEBUG [Listener at jenkins-hbase20.apache.org/39825] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ebc1809 to 127.0.0.1:55155 2023-09-26 04:03:14,628 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-26 04:03:14,629 DEBUG [Listener at jenkins-hbase20.apache.org/39825] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:03:14,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 04:03:14,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 04:03:14,630 INFO [Listener at jenkins-hbase20.apache.org/39825] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,43719,1695700858548' ***** 2023-09-26 04:03:14,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 04:03:14,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-26 04:03:14,630 DEBUG [Listener at jenkins-hbase20.apache.org/39825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:03:14,630 INFO [Listener at jenkins-hbase20.apache.org/39825] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-26 04:03:14,630 INFO [Listener at jenkins-hbase20.apache.org/39825] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,34445,1695700858593' ***** 2023-09-26 04:03:14,630 DEBUG [Listener at jenkins-hbase20.apache.org/39825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:03:14,630 INFO [RS:0;jenkins-hbase20:43719] regionserver.HeapMemoryManager(220): Stopping 2023-09-26 04:03:14,630 INFO [Listener at jenkins-hbase20.apache.org/39825] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-26 04:03:14,630 INFO [Listener at jenkins-hbase20.apache.org/39825] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44553,1695700858629' ***** 2023-09-26 04:03:14,631 INFO [RS:1;jenkins-hbase20:34445] regionserver.HeapMemoryManager(220): Stopping 2023-09-26 04:03:14,630 INFO [RS:0;jenkins-hbase20:43719] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-26 04:03:14,631 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-26 04:03:14,631 INFO [RS:0;jenkins-hbase20:43719] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-26 04:03:14,631 INFO [RS:1;jenkins-hbase20:34445] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-26 04:03:14,631 INFO [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:03:14,631 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-26 04:03:14,631 DEBUG [Listener at jenkins-hbase20.apache.org/39825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:03:14,631 DEBUG [RS:0;jenkins-hbase20:43719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d193553 to 127.0.0.1:55155 2023-09-26 04:03:14,631 INFO [RS:1;jenkins-hbase20:34445] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-26 04:03:14,631 INFO [Listener at jenkins-hbase20.apache.org/39825] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-26 04:03:14,631 DEBUG [RS:0;jenkins-hbase20:43719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:03:14,631 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(3305): Received CLOSE for dbeb6b48238ce29593f05f126a81ef9f 2023-09-26 04:03:14,631 INFO [RS:2;jenkins-hbase20:44553] regionserver.HeapMemoryManager(220): Stopping 2023-09-26 04:03:14,634 INFO [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,43719,1695700858548; all regions closed. 2023-09-26 04:03:14,634 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-26 04:03:14,634 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(3305): Received CLOSE for e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:03:14,634 INFO [RS:2;jenkins-hbase20:44553] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-26 04:03:14,634 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:03:14,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing dbeb6b48238ce29593f05f126a81ef9f, disabling compactions & flushes 2023-09-26 04:03:14,635 DEBUG [RS:1;jenkins-hbase20:34445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77c8214c to 127.0.0.1:55155 2023-09-26 04:03:14,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:03:14,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:03:14,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. after waiting 0 ms 2023-09-26 04:03:14,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:03:14,635 INFO [RS:2;jenkins-hbase20:44553] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-26 04:03:14,635 DEBUG [RS:1;jenkins-hbase20:34445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:03:14,635 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:03:14,636 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-26 04:03:14,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing dbeb6b48238ce29593f05f126a81ef9f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-26 04:03:14,636 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1478): Online Regions={dbeb6b48238ce29593f05f126a81ef9f=hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f., e87da35e52c00eb894f507f4557e0ab2=hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2.} 2023-09-26 04:03:14,636 DEBUG [RS:2;jenkins-hbase20:44553] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4536983d to 127.0.0.1:55155 2023-09-26 04:03:14,636 DEBUG [RS:2;jenkins-hbase20:44553] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:03:14,637 INFO [RS:2;jenkins-hbase20:44553] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-26 04:03:14,637 INFO [RS:2;jenkins-hbase20:44553] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-26 04:03:14,637 INFO [RS:2;jenkins-hbase20:44553] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-26 04:03:14,637 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-26 04:03:14,637 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-26 04:03:14,637 DEBUG [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1504): Waiting on dbeb6b48238ce29593f05f126a81ef9f, e87da35e52c00eb894f507f4557e0ab2 2023-09-26 04:03:14,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-26 04:03:14,638 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-26 04:03:14,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-26 04:03:14,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-26 04:03:14,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-26 04:03:14,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-26 04:03:14,638 DEBUG [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-26 04:03:14,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-09-26 04:03:14,652 DEBUG [RS:0;jenkins-hbase20:43719] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/oldWALs 2023-09-26 04:03:14,652 INFO [RS:0;jenkins-hbase20:43719] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43719%2C1695700858548:(num 1695700860130) 2023-09-26 04:03:14,652 DEBUG [RS:0;jenkins-hbase20:43719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:03:14,652 INFO [RS:0;jenkins-hbase20:43719] regionserver.LeaseManager(133): Closed leases 2023-09-26 04:03:14,657 INFO [RS:0;jenkins-hbase20:43719] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-26 04:03:14,659 INFO [RS:0;jenkins-hbase20:43719] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-26 04:03:14,659 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-26 04:03:14,659 INFO [RS:0;jenkins-hbase20:43719] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-26 04:03:14,659 INFO [RS:0;jenkins-hbase20:43719] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-26 04:03:14,660 INFO [RS:0;jenkins-hbase20:43719] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43719 2023-09-26 04:03:14,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f/.tmp/l/9f0ef220c933429180a2580fb046a3ad 2023-09-26 04:03:14,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 04:03:14,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:03:14,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:03:14,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43719,1695700858548 2023-09-26 04:03:14,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 04:03:14,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 04:03:14,667 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 04:03:14,668 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,43719,1695700858548] 2023-09-26 04:03:14,669 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,43719,1695700858548; numProcessing=1 2023-09-26 04:03:14,670 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,43719,1695700858548 already deleted, retry=false 2023-09-26 04:03:14,670 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,43719,1695700858548 expired; onlineServers=2 2023-09-26 04:03:14,671 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/.tmp/info/b7fc93ef03044e9cbf4d1b65a0d70c99 2023-09-26 04:03:14,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f0ef220c933429180a2580fb046a3ad 2023-09-26 04:03:14,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f/.tmp/l/9f0ef220c933429180a2580fb046a3ad as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f/l/9f0ef220c933429180a2580fb046a3ad 2023-09-26 04:03:14,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7fc93ef03044e9cbf4d1b65a0d70c99 2023-09-26 04:03:14,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f0ef220c933429180a2580fb046a3ad 2023-09-26 04:03:14,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f/l/9f0ef220c933429180a2580fb046a3ad, entries=7, sequenceid=18, filesize=5.2 K 2023-09-26 04:03:14,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for dbeb6b48238ce29593f05f126a81ef9f in 42ms, sequenceid=18, compaction requested=false 2023-09-26 04:03:14,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/acl/dbeb6b48238ce29593f05f126a81ef9f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-26 04:03:14,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:03:14,692 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-26 04:03:14,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:03:14,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for dbeb6b48238ce29593f05f126a81ef9f: 2023-09-26 04:03:14,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695700861330.dbeb6b48238ce29593f05f126a81ef9f. 2023-09-26 04:03:14,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e87da35e52c00eb894f507f4557e0ab2, disabling compactions & flushes 2023-09-26 04:03:14,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:03:14,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:03:14,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. after waiting 0 ms 2023-09-26 04:03:14,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:03:14,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e87da35e52c00eb894f507f4557e0ab2 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-26 04:03:14,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/.tmp/rep_barrier/16153b159fd54f47902e0b82d482b82b 2023-09-26 04:03:14,698 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-26 04:03:14,702 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 16153b159fd54f47902e0b82d482b82b 2023-09-26 04:03:14,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2/.tmp/info/a8a297b90f524e49983b5f3b9f2bd9d1 2023-09-26 04:03:14,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2/.tmp/info/a8a297b90f524e49983b5f3b9f2bd9d1 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2/info/a8a297b90f524e49983b5f3b9f2bd9d1 2023-09-26 04:03:14,716 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-26 04:03:14,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2/info/a8a297b90f524e49983b5f3b9f2bd9d1, entries=2, sequenceid=6, filesize=4.8 K 2023-09-26 04:03:14,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e87da35e52c00eb894f507f4557e0ab2 in 24ms, sequenceid=6, compaction requested=false 2023-09-26 04:03:14,732 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/.tmp/table/14f4b2c4d4324096a9d4acd7bfacb68e 2023-09-26 04:03:14,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/namespace/e87da35e52c00eb894f507f4557e0ab2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-26 04:03:14,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:03:14,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:03:14,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e87da35e52c00eb894f507f4557e0ab2: 2023-09-26 04:03:14,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695700860588.e87da35e52c00eb894f507f4557e0ab2. 2023-09-26 04:03:14,737 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14f4b2c4d4324096a9d4acd7bfacb68e 2023-09-26 04:03:14,737 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/.tmp/info/b7fc93ef03044e9cbf4d1b65a0d70c99 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/info/b7fc93ef03044e9cbf4d1b65a0d70c99 2023-09-26 04:03:14,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7fc93ef03044e9cbf4d1b65a0d70c99 2023-09-26 04:03:14,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/info/b7fc93ef03044e9cbf4d1b65a0d70c99, entries=48, sequenceid=131, filesize=10.3 K 2023-09-26 04:03:14,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/.tmp/rep_barrier/16153b159fd54f47902e0b82d482b82b as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/rep_barrier/16153b159fd54f47902e0b82d482b82b 2023-09-26 04:03:14,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 16153b159fd54f47902e0b82d482b82b 2023-09-26 04:03:14,748 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/rep_barrier/16153b159fd54f47902e0b82d482b82b, entries=13, sequenceid=131, filesize=6.4 K 2023-09-26 04:03:14,748 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/.tmp/table/14f4b2c4d4324096a9d4acd7bfacb68e as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/table/14f4b2c4d4324096a9d4acd7bfacb68e 2023-09-26 04:03:14,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14f4b2c4d4324096a9d4acd7bfacb68e 2023-09-26 04:03:14,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/table/14f4b2c4d4324096a9d4acd7bfacb68e, entries=24, sequenceid=131, filesize=6.9 K 2023-09-26 04:03:14,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 115ms, sequenceid=131, compaction requested=false 2023-09-26 04:03:14,765 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-26 04:03:14,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-26 04:03:14,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-26 04:03:14,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-26 04:03:14,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-26 04:03:14,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-26 04:03:14,769 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 04:03:14,769 INFO [RS:0;jenkins-hbase20:43719] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,43719,1695700858548; zookeeper connection closed. 2023-09-26 04:03:14,769 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x100d1e880710001, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 04:03:14,770 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@dd5522f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@dd5522f 2023-09-26 04:03:14,838 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,34445,1695700858593; all regions closed. 2023-09-26 04:03:14,838 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44553,1695700858629; all regions closed. 2023-09-26 04:03:14,844 DEBUG [RS:1;jenkins-hbase20:34445] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/oldWALs 2023-09-26 04:03:14,844 DEBUG [RS:2;jenkins-hbase20:44553] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/oldWALs 2023-09-26 04:03:14,844 INFO [RS:1;jenkins-hbase20:34445] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34445%2C1695700858593:(num 1695700860130) 2023-09-26 04:03:14,844 INFO [RS:2;jenkins-hbase20:44553] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44553%2C1695700858629.meta:.meta(num 1695700860276) 2023-09-26 04:03:14,844 DEBUG [RS:1;jenkins-hbase20:34445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:03:14,844 INFO [RS:1;jenkins-hbase20:34445] regionserver.LeaseManager(133): Closed leases 2023-09-26 04:03:14,844 INFO [RS:1;jenkins-hbase20:34445] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-26 04:03:14,845 INFO [RS:1;jenkins-hbase20:34445] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-26 04:03:14,845 INFO [RS:1;jenkins-hbase20:34445] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-26 04:03:14,845 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-26 04:03:14,845 INFO [RS:1;jenkins-hbase20:34445] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-26 04:03:14,846 INFO [RS:1;jenkins-hbase20:34445] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34445 2023-09-26 04:03:14,848 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 04:03:14,848 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:03:14,848 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34445,1695700858593 2023-09-26 04:03:14,849 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/WALs/jenkins-hbase20.apache.org,44553,1695700858629/jenkins-hbase20.apache.org%2C44553%2C1695700858629.1695700860130 not finished, retry = 0 2023-09-26 04:03:14,849 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34445,1695700858593] 2023-09-26 04:03:14,849 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34445,1695700858593; numProcessing=2 2023-09-26 04:03:14,850 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34445,1695700858593 already deleted, retry=false 2023-09-26 04:03:14,850 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34445,1695700858593 expired; onlineServers=1 2023-09-26 04:03:14,949 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 04:03:14,949 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:34445-0x100d1e880710002, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 04:03:14,949 INFO [RS:1;jenkins-hbase20:34445] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,34445,1695700858593; zookeeper connection closed. 2023-09-26 04:03:14,950 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@37a7e21e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@37a7e21e 2023-09-26 04:03:14,952 DEBUG [RS:2;jenkins-hbase20:44553] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/oldWALs 2023-09-26 04:03:14,952 INFO [RS:2;jenkins-hbase20:44553] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44553%2C1695700858629:(num 1695700860130) 2023-09-26 04:03:14,952 DEBUG [RS:2;jenkins-hbase20:44553] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:03:14,952 INFO [RS:2;jenkins-hbase20:44553] regionserver.LeaseManager(133): Closed leases 2023-09-26 04:03:14,953 INFO [RS:2;jenkins-hbase20:44553] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-26 04:03:14,953 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-26 04:03:14,954 INFO [RS:2;jenkins-hbase20:44553] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44553 2023-09-26 04:03:14,955 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44553,1695700858629 2023-09-26 04:03:14,955 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-26 04:03:14,956 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44553,1695700858629] 2023-09-26 04:03:14,956 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44553,1695700858629; numProcessing=3 2023-09-26 04:03:14,957 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44553,1695700858629 already deleted, retry=false 2023-09-26 04:03:14,957 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44553,1695700858629 expired; onlineServers=0 2023-09-26 04:03:14,957 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38025,1695700857519' ***** 2023-09-26 04:03:14,957 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-26 04:03:14,958 DEBUG [M:0;jenkins-hbase20:38025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fd4e8d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-26 04:03:14,958 INFO [M:0;jenkins-hbase20:38025] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38025,1695700857519 2023-09-26 04:03:14,958 INFO [M:0;jenkins-hbase20:38025] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38025,1695700857519; all regions closed. 2023-09-26 04:03:14,958 DEBUG [M:0;jenkins-hbase20:38025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-26 04:03:14,958 DEBUG [M:0;jenkins-hbase20:38025] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-26 04:03:14,959 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-26 04:03:14,959 DEBUG [M:0;jenkins-hbase20:38025] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-26 04:03:14,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1695700859781] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1695700859781,5,FailOnTimeoutGroup] 2023-09-26 04:03:14,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1695700859781] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1695700859781,5,FailOnTimeoutGroup] 2023-09-26 04:03:14,959 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-26 04:03:14,959 INFO [M:0;jenkins-hbase20:38025] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-26 04:03:14,959 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-26 04:03:14,959 INFO [M:0;jenkins-hbase20:38025] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-26 04:03:14,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-26 04:03:14,959 INFO [M:0;jenkins-hbase20:38025] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-09-26 04:03:14,960 DEBUG [M:0;jenkins-hbase20:38025] master.HMaster(1512): Stopping service threads 2023-09-26 04:03:14,960 INFO [M:0;jenkins-hbase20:38025] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-26 04:03:14,960 ERROR [M:0;jenkins-hbase20:38025] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-16,5,PEWorkerGroup] 2023-09-26 04:03:14,961 INFO [M:0;jenkins-hbase20:38025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-26 04:03:14,961 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-26 04:03:14,962 DEBUG [M:0;jenkins-hbase20:38025] zookeeper.ZKUtil(398): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-26 04:03:14,962 WARN [M:0;jenkins-hbase20:38025] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-26 04:03:14,962 INFO [M:0;jenkins-hbase20:38025] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-26 04:03:14,962 INFO [M:0;jenkins-hbase20:38025] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-26 04:03:14,963 DEBUG [M:0;jenkins-hbase20:38025] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-26 04:03:14,963 INFO [M:0;jenkins-hbase20:38025] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 04:03:14,963 DEBUG [M:0;jenkins-hbase20:38025] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 04:03:14,963 DEBUG [M:0;jenkins-hbase20:38025] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-26 04:03:14,963 DEBUG [M:0;jenkins-hbase20:38025] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 04:03:14,963 INFO [M:0;jenkins-hbase20:38025] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.79 KB heapSize=452.02 KB 2023-09-26 04:03:14,978 INFO [M:0;jenkins-hbase20:38025] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.79 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/71d3825079d64a8cbb7558729fb7a399 2023-09-26 04:03:14,981 INFO [M:0;jenkins-hbase20:38025] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71d3825079d64a8cbb7558729fb7a399 2023-09-26 04:03:14,982 DEBUG [M:0;jenkins-hbase20:38025] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/71d3825079d64a8cbb7558729fb7a399 as hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/71d3825079d64a8cbb7558729fb7a399 2023-09-26 04:03:14,986 INFO [M:0;jenkins-hbase20:38025] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71d3825079d64a8cbb7558729fb7a399 2023-09-26 04:03:14,986 INFO [M:0;jenkins-hbase20:38025] regionserver.HStore(1080): Added hdfs://localhost:36857/user/jenkins/test-data/ca836fb0-8be5-eb8b-86c4-d7a2d0509faa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/71d3825079d64a8cbb7558729fb7a399, entries=119, sequenceid=899, filesize=28.6 K 2023-09-26 04:03:14,986 INFO [M:0;jenkins-hbase20:38025] regionserver.HRegion(2948): Finished flush of dataSize ~375.79 KB/384810, heapSize ~452.01 KB/462856, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-09-26 04:03:14,988 INFO [M:0;jenkins-hbase20:38025] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-26 04:03:14,988 DEBUG [M:0;jenkins-hbase20:38025] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-26 04:03:14,991 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-26 04:03:14,991 INFO [M:0;jenkins-hbase20:38025] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-26 04:03:14,992 INFO [M:0;jenkins-hbase20:38025] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38025 2023-09-26 04:03:14,993 DEBUG [M:0;jenkins-hbase20:38025] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,38025,1695700857519 already deleted, retry=false 2023-09-26 04:03:15,057 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 04:03:15,057 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): regionserver:44553-0x100d1e880710003, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 04:03:15,057 INFO [RS:2;jenkins-hbase20:44553] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44553,1695700858629; zookeeper connection closed. 2023-09-26 04:03:15,058 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@140a554d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@140a554d 2023-09-26 04:03:15,058 INFO [Listener at jenkins-hbase20.apache.org/39825] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-26 04:03:15,157 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 04:03:15,157 INFO [M:0;jenkins-hbase20:38025] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38025,1695700857519; zookeeper connection closed. 2023-09-26 04:03:15,157 DEBUG [Listener at localhost/44669-EventThread] zookeeper.ZKWatcher(600): master:38025-0x100d1e880710000, quorum=127.0.0.1:55155, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-26 04:03:15,161 WARN [Listener at jenkins-hbase20.apache.org/39825] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-26 04:03:15,166 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-26 04:03:15,274 WARN [BP-946302761-148.251.75.209-1695700854256 heartbeating to localhost/127.0.0.1:36857] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-26 04:03:15,274 WARN [BP-946302761-148.251.75.209-1695700854256 heartbeating to localhost/127.0.0.1:36857] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-946302761-148.251.75.209-1695700854256 (Datanode Uuid 5c820087-8854-4222-ac01-a6b1d6bff6be) service to localhost/127.0.0.1:36857 2023-09-26 04:03:15,277 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data5/current/BP-946302761-148.251.75.209-1695700854256] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 04:03:15,277 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data6/current/BP-946302761-148.251.75.209-1695700854256] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 04:03:15,278 WARN [Listener at jenkins-hbase20.apache.org/39825] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-26 04:03:15,280 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-26 04:03:15,384 WARN [BP-946302761-148.251.75.209-1695700854256 heartbeating to localhost/127.0.0.1:36857] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-26 04:03:15,384 WARN [BP-946302761-148.251.75.209-1695700854256 heartbeating to localhost/127.0.0.1:36857] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-946302761-148.251.75.209-1695700854256 (Datanode Uuid ce612958-6f8a-44cb-b69d-f0f69749b9f9) service to localhost/127.0.0.1:36857 2023-09-26 04:03:15,386 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data3/current/BP-946302761-148.251.75.209-1695700854256] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 04:03:15,387 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data4/current/BP-946302761-148.251.75.209-1695700854256] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 04:03:15,387 WARN [Listener at jenkins-hbase20.apache.org/39825] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-26 04:03:15,391 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-26 04:03:15,495 WARN [BP-946302761-148.251.75.209-1695700854256 heartbeating to localhost/127.0.0.1:36857] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-26 04:03:15,495 WARN [BP-946302761-148.251.75.209-1695700854256 heartbeating to localhost/127.0.0.1:36857] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-946302761-148.251.75.209-1695700854256 (Datanode Uuid 6f7780c7-0017-460e-aa4e-b45bbebcc480) service to localhost/127.0.0.1:36857 2023-09-26 04:03:15,497 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data1/current/BP-946302761-148.251.75.209-1695700854256] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 04:03:15,497 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dfb12dd-5e67-cf88-d583-b5d2363ccb1f/cluster_a29141aa-e884-ca45-10c0-7100845e74f2/dfs/data/data2/current/BP-946302761-148.251.75.209-1695700854256] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-26 04:03:15,518 INFO [Listener at jenkins-hbase20.apache.org/39825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-26 04:03:15,646 INFO [Listener at jenkins-hbase20.apache.org/39825] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-26 04:03:15,725 INFO [Listener at jenkins-hbase20.apache.org/39825] hbase.HBaseTestingUtility(1293): Minicluster is down