2023-07-13 23:11:24,367 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-13 23:11:24,596 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16 2023-07-13 23:11:24,596 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-13 23:11:24,597 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-13 23:11:24,637 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-13 23:11:24,924 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-13 23:11:24,925 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97, deleteOnExit=true 2023-07-13 23:11:24,925 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-13 23:11:24,926 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/test.cache.data in system properties and HBase conf 2023-07-13 23:11:24,927 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop.tmp.dir in system properties and HBase conf 2023-07-13 23:11:24,927 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop.log.dir in system properties and HBase conf 2023-07-13 23:11:24,928 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-13 23:11:24,928 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-13 23:11:24,928 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-13 23:11:25,354 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-13 23:11:25,361 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-13 23:11:25,362 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-13 23:11:25,362 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-13 23:11:25,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 23:11:25,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-13 23:11:25,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-13 23:11:25,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 23:11:25,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 23:11:25,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-13 23:11:25,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/nfs.dump.dir in system properties and HBase conf 2023-07-13 23:11:25,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir in system properties and HBase conf 2023-07-13 23:11:25,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 23:11:25,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-13 23:11:25,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-13 23:11:26,060 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-13 23:11:26,065 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-13 23:11:26,423 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-13 23:11:26,630 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-13 23:11:26,645 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:26,690 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:26,726 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir/Jetty_localhost_36409_hdfs____tgvov8/webapp 2023-07-13 23:11:26,916 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36409 2023-07-13 23:11:26,928 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-13 23:11:26,928 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-13 23:11:27,523 WARN [Listener at localhost/33689] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 23:11:27,632 WARN [Listener at localhost/33689] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 23:11:27,676 WARN [Listener at localhost/33689] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:27,757 INFO [Listener at localhost/33689] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:27,772 INFO [Listener at localhost/33689] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir/Jetty_localhost_40309_datanode____.qrkp7d/webapp 2023-07-13 23:11:27,923 INFO [Listener at localhost/33689] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40309 2023-07-13 23:11:28,447 WARN [Listener at localhost/41113] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 23:11:28,482 WARN [Listener at localhost/41113] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 23:11:28,487 WARN [Listener at localhost/41113] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:28,489 INFO [Listener at localhost/41113] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:28,498 INFO [Listener at localhost/41113] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir/Jetty_localhost_35795_datanode____nk0llk/webapp 2023-07-13 23:11:28,642 INFO [Listener at localhost/41113] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35795 2023-07-13 23:11:28,670 WARN [Listener at localhost/39841] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 23:11:28,764 WARN [Listener at localhost/39841] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 23:11:28,771 WARN [Listener at localhost/39841] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:28,773 INFO [Listener at localhost/39841] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:28,792 INFO [Listener at localhost/39841] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir/Jetty_localhost_33053_datanode____.jwhzfv/webapp 2023-07-13 23:11:28,996 INFO [Listener at localhost/39841] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33053 2023-07-13 23:11:29,037 WARN [Listener at localhost/39383] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 23:11:29,291 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe61399d5863f0732: Processing first storage report for DS-952f632b-c442-470a-b2a1-7edfa7d6d644 from datanode 94aee38c-4c00-4ec5-a7cd-7ac8a1aa3f27 2023-07-13 23:11:29,293 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe61399d5863f0732: from storage DS-952f632b-c442-470a-b2a1-7edfa7d6d644 node DatanodeRegistration(127.0.0.1:40917, datanodeUuid=94aee38c-4c00-4ec5-a7cd-7ac8a1aa3f27, infoPort=44593, infoSecurePort=0, ipcPort=41113, storageInfo=lv=-57;cid=testClusterID;nsid=457187709;c=1689289886155), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,293 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8cab2b84819baf78: Processing first storage report for DS-a5820b1d-9a4b-4594-b39a-61caf5969c19 from datanode 8bde7aa9-4fdc-44d0-aa2c-d0adced80296 2023-07-13 23:11:29,293 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8cab2b84819baf78: from storage DS-a5820b1d-9a4b-4594-b39a-61caf5969c19 node DatanodeRegistration(127.0.0.1:37555, datanodeUuid=8bde7aa9-4fdc-44d0-aa2c-d0adced80296, infoPort=41421, infoSecurePort=0, ipcPort=39841, storageInfo=lv=-57;cid=testClusterID;nsid=457187709;c=1689289886155), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,293 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe61399d5863f0732: Processing first storage report for DS-fefefa8d-ece6-4cab-af0a-c69ab5a67789 from datanode 94aee38c-4c00-4ec5-a7cd-7ac8a1aa3f27 2023-07-13 23:11:29,294 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe61399d5863f0732: from storage DS-fefefa8d-ece6-4cab-af0a-c69ab5a67789 node DatanodeRegistration(127.0.0.1:40917, datanodeUuid=94aee38c-4c00-4ec5-a7cd-7ac8a1aa3f27, infoPort=44593, infoSecurePort=0, ipcPort=41113, storageInfo=lv=-57;cid=testClusterID;nsid=457187709;c=1689289886155), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,294 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8cab2b84819baf78: Processing first storage report for DS-1f79a759-81ac-4795-bc9f-256243807400 from datanode 8bde7aa9-4fdc-44d0-aa2c-d0adced80296 2023-07-13 23:11:29,294 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8cab2b84819baf78: from storage DS-1f79a759-81ac-4795-bc9f-256243807400 node DatanodeRegistration(127.0.0.1:37555, datanodeUuid=8bde7aa9-4fdc-44d0-aa2c-d0adced80296, infoPort=41421, infoSecurePort=0, ipcPort=39841, storageInfo=lv=-57;cid=testClusterID;nsid=457187709;c=1689289886155), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,296 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x417388407d79db42: Processing first storage report for DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772 from datanode 7c7d8563-5a5d-4d31-b086-ea887a3e4482 2023-07-13 23:11:29,297 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x417388407d79db42: from storage DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772 node DatanodeRegistration(127.0.0.1:44693, datanodeUuid=7c7d8563-5a5d-4d31-b086-ea887a3e4482, infoPort=45991, infoSecurePort=0, ipcPort=39383, storageInfo=lv=-57;cid=testClusterID;nsid=457187709;c=1689289886155), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,297 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x417388407d79db42: Processing first storage report for DS-64764c98-5921-4157-bea3-514ec14963d7 from datanode 7c7d8563-5a5d-4d31-b086-ea887a3e4482 2023-07-13 23:11:29,297 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x417388407d79db42: from storage DS-64764c98-5921-4157-bea3-514ec14963d7 node DatanodeRegistration(127.0.0.1:44693, datanodeUuid=7c7d8563-5a5d-4d31-b086-ea887a3e4482, infoPort=45991, infoSecurePort=0, ipcPort=39383, storageInfo=lv=-57;cid=testClusterID;nsid=457187709;c=1689289886155), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,613 DEBUG [Listener at localhost/39383] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16 2023-07-13 23:11:29,713 INFO [Listener at localhost/39383] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/zookeeper_0, clientPort=63739, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-13 23:11:29,743 INFO [Listener at localhost/39383] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63739 2023-07-13 23:11:29,756 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:29,759 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:30,476 INFO [Listener at localhost/39383] util.FSUtils(471): Created version file at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 with version=8 2023-07-13 23:11:30,476 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/hbase-staging 2023-07-13 23:11:30,870 INFO [Listener at localhost/39383] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-13 23:11:31,486 INFO [Listener at localhost/39383] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-13 23:11:31,523 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:31,524 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:31,524 INFO [Listener at localhost/39383] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 23:11:31,524 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:31,525 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 23:11:31,691 INFO [Listener at localhost/39383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 23:11:31,777 DEBUG [Listener at localhost/39383] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-13 23:11:31,875 INFO [Listener at localhost/39383] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46453 2023-07-13 23:11:31,891 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:31,894 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:31,922 INFO [Listener at localhost/39383] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46453 connecting to ZooKeeper ensemble=127.0.0.1:63739 2023-07-13 23:11:32,016 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:464530x0, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 23:11:32,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46453-0x10160f49a930000 connected 2023-07-13 23:11:32,080 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:11:32,081 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:11:32,094 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 23:11:32,104 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46453 2023-07-13 23:11:32,104 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46453 2023-07-13 23:11:32,105 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46453 2023-07-13 23:11:32,105 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46453 2023-07-13 23:11:32,106 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46453 2023-07-13 23:11:32,114 INFO [Listener at localhost/39383] master.HMaster(444): hbase.rootdir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29, hbase.cluster.distributed=false 2023-07-13 23:11:32,197 INFO [Listener at localhost/39383] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-13 23:11:32,197 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,198 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,198 INFO [Listener at localhost/39383] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 23:11:32,198 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,198 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 23:11:32,212 INFO [Listener at localhost/39383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 23:11:32,215 INFO [Listener at localhost/39383] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37295 2023-07-13 23:11:32,218 INFO [Listener at localhost/39383] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 23:11:32,245 INFO [Listener at localhost/39383] mob.MobFileCache(124): MobFileCache disabled 2023-07-13 23:11:32,247 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,250 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,259 INFO [Listener at localhost/39383] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37295 connecting to ZooKeeper ensemble=127.0.0.1:63739 2023-07-13 23:11:32,263 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:372950x0, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 23:11:32,265 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): regionserver:372950x0, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:11:32,267 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): regionserver:372950x0, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:11:32,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37295-0x10160f49a930001 connected 2023-07-13 23:11:32,269 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 23:11:32,279 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37295 2023-07-13 23:11:32,279 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37295 2023-07-13 23:11:32,283 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37295 2023-07-13 23:11:32,284 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37295 2023-07-13 23:11:32,284 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37295 2023-07-13 23:11:32,304 INFO [Listener at localhost/39383] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-13 23:11:32,305 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,305 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,305 INFO [Listener at localhost/39383] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 23:11:32,305 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,306 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 23:11:32,306 INFO [Listener at localhost/39383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 23:11:32,309 INFO [Listener at localhost/39383] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43615 2023-07-13 23:11:32,309 INFO [Listener at localhost/39383] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 23:11:32,314 INFO [Listener at localhost/39383] mob.MobFileCache(124): MobFileCache disabled 2023-07-13 23:11:32,315 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,317 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,324 INFO [Listener at localhost/39383] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43615 connecting to ZooKeeper ensemble=127.0.0.1:63739 2023-07-13 23:11:32,331 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:436150x0, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 23:11:32,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43615-0x10160f49a930002 connected 2023-07-13 23:11:32,333 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:11:32,334 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:11:32,335 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 23:11:32,336 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43615 2023-07-13 23:11:32,336 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43615 2023-07-13 23:11:32,342 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43615 2023-07-13 23:11:32,343 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43615 2023-07-13 23:11:32,343 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43615 2023-07-13 23:11:32,355 INFO [Listener at localhost/39383] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-13 23:11:32,355 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,356 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,356 INFO [Listener at localhost/39383] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 23:11:32,356 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,356 INFO [Listener at localhost/39383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 23:11:32,356 INFO [Listener at localhost/39383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 23:11:32,358 INFO [Listener at localhost/39383] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34053 2023-07-13 23:11:32,359 INFO [Listener at localhost/39383] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 23:11:32,362 INFO [Listener at localhost/39383] mob.MobFileCache(124): MobFileCache disabled 2023-07-13 23:11:32,363 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,365 INFO [Listener at localhost/39383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,366 INFO [Listener at localhost/39383] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34053 connecting to ZooKeeper ensemble=127.0.0.1:63739 2023-07-13 23:11:32,372 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:340530x0, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 23:11:32,373 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): regionserver:340530x0, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:11:32,374 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): regionserver:340530x0, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:11:32,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34053-0x10160f49a930003 connected 2023-07-13 23:11:32,376 DEBUG [Listener at localhost/39383] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 23:11:32,380 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34053 2023-07-13 23:11:32,382 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34053 2023-07-13 23:11:32,390 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34053 2023-07-13 23:11:32,390 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34053 2023-07-13 23:11:32,390 DEBUG [Listener at localhost/39383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34053 2023-07-13 23:11:32,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:11:32,406 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-13 23:11:32,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:11:32,435 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 23:11:32,435 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 23:11:32,436 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:32,435 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 23:11:32,436 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 23:11:32,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-13 23:11:32,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46453,1689289890678 from backup master directory 2023-07-13 23:11:32,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-13 23:11:32,446 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:11:32,446 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-13 23:11:32,447 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 23:11:32,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:11:32,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-13 23:11:32,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-13 23:11:32,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/hbase.id with ID: 2dfb6bdc-16c5-4ebd-ad42-754ad8064534 2023-07-13 23:11:32,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,703 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:32,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7a5c9e14 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:32,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@766dcc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:32,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:11:32,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-13 23:11:32,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-13 23:11:32,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-13 23:11:32,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-13 23:11:32,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-13 23:11:32,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:32,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/data/master/store-tmp 2023-07-13 23:11:32,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:32,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-13 23:11:32,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:11:32,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:11:32,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-13 23:11:32,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:11:32,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:11:32,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 23:11:32,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/WALs/jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:11:33,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46453%2C1689289890678, suffix=, logDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/WALs/jenkins-hbase4.apache.org,46453,1689289890678, archiveDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/oldWALs, maxLogs=10 2023-07-13 23:11:33,088 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK] 2023-07-13 23:11:33,088 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK] 2023-07-13 23:11:33,088 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK] 2023-07-13 23:11:33,109 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-13 23:11:33,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/WALs/jenkins-hbase4.apache.org,46453,1689289890678/jenkins-hbase4.apache.org%2C46453%2C1689289890678.1689289893022 2023-07-13 23:11:33,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK], DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK], DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK]] 2023-07-13 23:11:33,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:11:33,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:33,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,318 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,327 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-13 23:11:33,363 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-13 23:11:33,377 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:33,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:33,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68073764, jitterRate=0.014378130435943604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:33,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 23:11:33,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-13 23:11:33,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-13 23:11:33,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-13 23:11:33,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-13 23:11:33,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-13 23:11:33,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-13 23:11:33,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-13 23:11:33,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-13 23:11:33,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-13 23:11:33,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-13 23:11:33,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-13 23:11:33,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-13 23:11:33,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-13 23:11:33,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-13 23:11:33,570 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:33,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-13 23:11:33,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-13 23:11:33,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-13 23:11:33,602 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 23:11:33,602 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 23:11:33,602 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 23:11:33,602 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 23:11:33,603 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:33,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46453,1689289890678, sessionid=0x10160f49a930000, setting cluster-up flag (Was=false) 2023-07-13 23:11:33,631 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:33,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-13 23:11:33,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:11:33,656 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:33,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-13 23:11:33,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:11:33,672 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp 2023-07-13 23:11:33,705 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(951): ClusterId : 2dfb6bdc-16c5-4ebd-ad42-754ad8064534 2023-07-13 23:11:33,706 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(951): ClusterId : 2dfb6bdc-16c5-4ebd-ad42-754ad8064534 2023-07-13 23:11:33,713 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(951): ClusterId : 2dfb6bdc-16c5-4ebd-ad42-754ad8064534 2023-07-13 23:11:33,719 DEBUG [RS:0;jenkins-hbase4:37295] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 23:11:33,719 DEBUG [RS:2;jenkins-hbase4:34053] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 23:11:33,719 DEBUG [RS:1;jenkins-hbase4:43615] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 23:11:33,734 DEBUG [RS:1;jenkins-hbase4:43615] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 23:11:33,734 DEBUG [RS:1;jenkins-hbase4:43615] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 23:11:33,734 DEBUG [RS:2;jenkins-hbase4:34053] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 23:11:33,734 DEBUG [RS:2;jenkins-hbase4:34053] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 23:11:33,747 DEBUG [RS:1;jenkins-hbase4:43615] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 23:11:33,747 DEBUG [RS:2;jenkins-hbase4:34053] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 23:11:33,751 DEBUG [RS:0;jenkins-hbase4:37295] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 23:11:33,751 DEBUG [RS:1;jenkins-hbase4:43615] zookeeper.ReadOnlyZKClient(139): Connect 0x19afe29d to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:33,752 DEBUG [RS:0;jenkins-hbase4:37295] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 23:11:33,752 DEBUG [RS:2;jenkins-hbase4:34053] zookeeper.ReadOnlyZKClient(139): Connect 0x20ad8ddf to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:33,756 DEBUG [RS:0;jenkins-hbase4:37295] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 23:11:33,760 DEBUG [RS:0;jenkins-hbase4:37295] zookeeper.ReadOnlyZKClient(139): Connect 0x01730409 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:33,810 DEBUG [RS:2;jenkins-hbase4:34053] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e6a67ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:33,812 DEBUG [RS:2;jenkins-hbase4:34053] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a55e6af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-13 23:11:33,816 DEBUG [RS:1;jenkins-hbase4:43615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17681fd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:33,817 DEBUG [RS:1;jenkins-hbase4:43615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@135789ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-13 23:11:33,822 DEBUG [RS:0;jenkins-hbase4:37295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fb4ea57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:33,823 DEBUG [RS:0;jenkins-hbase4:37295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b8b6f79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-13 23:11:33,848 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34053 2023-07-13 23:11:33,865 INFO [RS:2;jenkins-hbase4:34053] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 23:11:33,867 INFO [RS:2;jenkins-hbase4:34053] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 23:11:33,866 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37295 2023-07-13 23:11:33,858 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43615 2023-07-13 23:11:33,871 INFO [RS:1;jenkins-hbase4:43615] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 23:11:33,877 INFO [RS:1;jenkins-hbase4:43615] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 23:11:33,871 INFO [RS:0;jenkins-hbase4:37295] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 23:11:33,877 INFO [RS:0;jenkins-hbase4:37295] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 23:11:33,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-13 23:11:33,889 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 23:11:33,889 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 23:11:33,889 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 23:11:33,891 INFO [RS:1;jenkins-hbase4:43615] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:33,892 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 23:11:33,896 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46453,1689289890678 with isa=jenkins-hbase4.apache.org/172.31.14.131:43615, startcode=1689289892304 2023-07-13 23:11:33,891 INFO [RS:0;jenkins-hbase4:37295] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:33,899 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 23:11:33,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:33,891 INFO [RS:2;jenkins-hbase4:34053] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:33,899 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 23:11:33,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-13 23:11:33,900 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46453,1689289890678 with isa=jenkins-hbase4.apache.org/172.31.14.131:34053, startcode=1689289892354 2023-07-13 23:11:33,907 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46453,1689289890678 with isa=jenkins-hbase4.apache.org/172.31.14.131:37295, startcode=1689289892196 2023-07-13 23:11:33,920 DEBUG [RS:2;jenkins-hbase4:34053] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 23:11:33,920 DEBUG [RS:0;jenkins-hbase4:37295] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 23:11:33,920 DEBUG [RS:1;jenkins-hbase4:43615] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 23:11:34,032 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34801, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 23:11:34,032 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50109, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 23:11:34,035 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34907, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 23:11:34,048 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46453] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 23:11:34,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-13 23:11:34,062 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46453] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 23:11:34,064 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46453] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 23:11:34,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-13 23:11:34,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-13 23:11:34,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-13 23:11:34,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-13 23:11:34,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-13 23:11:34,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-13 23:11:34,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689289924123 2023-07-13 23:11:34,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-13 23:11:34,137 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 23:11:34,137 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 23:11:34,137 WARN [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 23:11:34,137 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 23:11:34,137 WARN [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 23:11:34,137 WARN [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 23:11:34,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-13 23:11:34,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-13 23:11:34,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-13 23:11:34,149 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-13 23:11:34,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-13 23:11:34,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-13 23:11:34,150 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-13 23:11:34,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-13 23:11:34,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-13 23:11:34,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-13 23:11:34,159 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 23:11:34,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-13 23:11:34,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-13 23:11:34,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689289894168,5,FailOnTimeoutGroup] 2023-07-13 23:11:34,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689289894169,5,FailOnTimeoutGroup] 2023-07-13 23:11:34,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-13 23:11:34,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,236 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:34,238 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:34,239 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46453,1689289890678 with isa=jenkins-hbase4.apache.org/172.31.14.131:43615, startcode=1689289892304 2023-07-13 23:11:34,240 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46453,1689289890678 with isa=jenkins-hbase4.apache.org/172.31.14.131:34053, startcode=1689289892354 2023-07-13 23:11:34,241 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46453,1689289890678 with isa=jenkins-hbase4.apache.org/172.31.14.131:37295, startcode=1689289892196 2023-07-13 23:11:34,243 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:11:34,251 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46453] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:34,259 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46453] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:34,260 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46453] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:34,273 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:11:34,278 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:11:34,279 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33689 2023-07-13 23:11:34,279 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 23:11:34,278 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33689 2023-07-13 23:11:34,279 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 23:11:34,278 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:11:34,279 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33689 2023-07-13 23:11:34,280 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 23:11:34,291 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:11:34,292 DEBUG [RS:2;jenkins-hbase4:34053] zookeeper.ZKUtil(162): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:34,292 DEBUG [RS:1;jenkins-hbase4:43615] zookeeper.ZKUtil(162): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:34,292 DEBUG [RS:0;jenkins-hbase4:37295] zookeeper.ZKUtil(162): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:34,292 WARN [RS:2;jenkins-hbase4:34053] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 23:11:34,292 INFO [RS:2;jenkins-hbase4:34053] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:34,293 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:34,292 WARN [RS:1;jenkins-hbase4:43615] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 23:11:34,292 WARN [RS:0;jenkins-hbase4:37295] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 23:11:34,298 INFO [RS:1;jenkins-hbase4:43615] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:34,308 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:34,298 INFO [RS:0;jenkins-hbase4:37295] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:34,308 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:34,309 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34053,1689289892354] 2023-07-13 23:11:34,309 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43615,1689289892304] 2023-07-13 23:11:34,310 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37295,1689289892196] 2023-07-13 23:11:34,350 DEBUG [RS:2;jenkins-hbase4:34053] zookeeper.ZKUtil(162): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:34,351 DEBUG [RS:1;jenkins-hbase4:43615] zookeeper.ZKUtil(162): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:34,351 DEBUG [RS:0;jenkins-hbase4:37295] zookeeper.ZKUtil(162): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:34,352 DEBUG [RS:1;jenkins-hbase4:43615] zookeeper.ZKUtil(162): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:34,353 DEBUG [RS:1;jenkins-hbase4:43615] zookeeper.ZKUtil(162): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:34,355 DEBUG [RS:0;jenkins-hbase4:37295] zookeeper.ZKUtil(162): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:34,355 DEBUG [RS:2;jenkins-hbase4:34053] zookeeper.ZKUtil(162): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:34,355 DEBUG [RS:0;jenkins-hbase4:37295] zookeeper.ZKUtil(162): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:34,356 DEBUG [RS:2;jenkins-hbase4:34053] zookeeper.ZKUtil(162): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:34,365 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:34,368 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 23:11:34,368 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 23:11:34,368 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 23:11:34,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-13 23:11:34,380 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/info 2023-07-13 23:11:34,381 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-13 23:11:34,382 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:34,382 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-13 23:11:34,385 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/rep_barrier 2023-07-13 23:11:34,386 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-13 23:11:34,387 INFO [RS:1;jenkins-hbase4:43615] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 23:11:34,387 INFO [RS:2;jenkins-hbase4:34053] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 23:11:34,388 INFO [RS:0;jenkins-hbase4:37295] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 23:11:34,389 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:34,389 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-13 23:11:34,395 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/table 2023-07-13 23:11:34,395 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-13 23:11:34,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:34,399 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740 2023-07-13 23:11:34,403 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740 2023-07-13 23:11:34,407 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-13 23:11:34,409 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-13 23:11:34,413 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:34,414 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62350308, jitterRate=-0.07090801000595093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-13 23:11:34,414 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-13 23:11:34,414 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-13 23:11:34,414 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-13 23:11:34,414 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-13 23:11:34,415 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-13 23:11:34,415 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-13 23:11:34,422 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-13 23:11:34,422 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-13 23:11:34,434 INFO [RS:0;jenkins-hbase4:37295] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 23:11:34,434 INFO [RS:1;jenkins-hbase4:43615] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 23:11:34,436 INFO [RS:2;jenkins-hbase4:34053] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 23:11:34,439 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-13 23:11:34,439 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-13 23:11:34,442 INFO [RS:1;jenkins-hbase4:43615] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 23:11:34,442 INFO [RS:2;jenkins-hbase4:34053] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 23:11:34,442 INFO [RS:0;jenkins-hbase4:37295] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 23:11:34,443 INFO [RS:2;jenkins-hbase4:34053] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,443 INFO [RS:1;jenkins-hbase4:43615] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,444 INFO [RS:0;jenkins-hbase4:37295] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,444 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 23:11:34,451 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 23:11:34,451 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 23:11:34,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-13 23:11:34,461 INFO [RS:2;jenkins-hbase4:34053] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,461 INFO [RS:1;jenkins-hbase4:43615] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,461 INFO [RS:0;jenkins-hbase4:37295] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,461 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,461 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,461 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,461 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-13 23:11:34,462 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,463 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,462 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,463 DEBUG [RS:2;jenkins-hbase4:34053] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,463 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,463 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-13 23:11:34,463 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-13 23:11:34,463 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,463 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,463 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,463 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,463 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,463 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,464 DEBUG [RS:1;jenkins-hbase4:43615] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,464 DEBUG [RS:0;jenkins-hbase4:37295] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,474 INFO [RS:0;jenkins-hbase4:37295] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,475 INFO [RS:0;jenkins-hbase4:37295] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,475 INFO [RS:0;jenkins-hbase4:37295] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,490 INFO [RS:2;jenkins-hbase4:34053] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,491 INFO [RS:2;jenkins-hbase4:34053] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,491 INFO [RS:2;jenkins-hbase4:34053] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,501 INFO [RS:0;jenkins-hbase4:37295] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 23:11:34,507 INFO [RS:0;jenkins-hbase4:37295] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37295,1689289892196-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,522 INFO [RS:1;jenkins-hbase4:43615] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,522 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-13 23:11:34,523 INFO [RS:1;jenkins-hbase4:43615] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,523 INFO [RS:1;jenkins-hbase4:43615] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,528 INFO [RS:2;jenkins-hbase4:34053] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 23:11:34,539 INFO [RS:2;jenkins-hbase4:34053] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34053,1689289892354-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,542 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-13 23:11:34,555 INFO [RS:1;jenkins-hbase4:43615] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 23:11:34,555 INFO [RS:1;jenkins-hbase4:43615] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43615,1689289892304-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,563 INFO [RS:0;jenkins-hbase4:37295] regionserver.Replication(203): jenkins-hbase4.apache.org,37295,1689289892196 started 2023-07-13 23:11:34,564 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37295,1689289892196, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37295, sessionid=0x10160f49a930001 2023-07-13 23:11:34,574 INFO [RS:2;jenkins-hbase4:34053] regionserver.Replication(203): jenkins-hbase4.apache.org,34053,1689289892354 started 2023-07-13 23:11:34,574 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34053,1689289892354, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34053, sessionid=0x10160f49a930003 2023-07-13 23:11:34,574 DEBUG [RS:2;jenkins-hbase4:34053] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 23:11:34,574 DEBUG [RS:2;jenkins-hbase4:34053] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:34,574 DEBUG [RS:2;jenkins-hbase4:34053] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34053,1689289892354' 2023-07-13 23:11:34,574 DEBUG [RS:2;jenkins-hbase4:34053] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 23:11:34,575 INFO [RS:1;jenkins-hbase4:43615] regionserver.Replication(203): jenkins-hbase4.apache.org,43615,1689289892304 started 2023-07-13 23:11:34,575 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43615,1689289892304, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43615, sessionid=0x10160f49a930002 2023-07-13 23:11:34,575 DEBUG [RS:2;jenkins-hbase4:34053] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 23:11:34,576 DEBUG [RS:0;jenkins-hbase4:37295] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 23:11:34,575 DEBUG [RS:1;jenkins-hbase4:43615] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 23:11:34,578 DEBUG [RS:2;jenkins-hbase4:34053] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 23:11:34,578 DEBUG [RS:2;jenkins-hbase4:34053] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 23:11:34,578 DEBUG [RS:2;jenkins-hbase4:34053] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:34,578 DEBUG [RS:2;jenkins-hbase4:34053] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34053,1689289892354' 2023-07-13 23:11:34,578 DEBUG [RS:2;jenkins-hbase4:34053] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:34,579 DEBUG [RS:2;jenkins-hbase4:34053] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:34,579 DEBUG [RS:2;jenkins-hbase4:34053] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 23:11:34,580 INFO [RS:2;jenkins-hbase4:34053] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 23:11:34,580 INFO [RS:2;jenkins-hbase4:34053] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 23:11:34,576 DEBUG [RS:0;jenkins-hbase4:37295] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:34,578 DEBUG [RS:1;jenkins-hbase4:43615] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:34,580 DEBUG [RS:1;jenkins-hbase4:43615] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43615,1689289892304' 2023-07-13 23:11:34,581 DEBUG [RS:1;jenkins-hbase4:43615] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 23:11:34,580 DEBUG [RS:0;jenkins-hbase4:37295] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37295,1689289892196' 2023-07-13 23:11:34,581 DEBUG [RS:1;jenkins-hbase4:43615] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 23:11:34,582 DEBUG [RS:1;jenkins-hbase4:43615] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 23:11:34,582 DEBUG [RS:1;jenkins-hbase4:43615] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 23:11:34,582 DEBUG [RS:1;jenkins-hbase4:43615] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:34,582 DEBUG [RS:1;jenkins-hbase4:43615] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43615,1689289892304' 2023-07-13 23:11:34,582 DEBUG [RS:1;jenkins-hbase4:43615] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:34,582 DEBUG [RS:1;jenkins-hbase4:43615] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:34,581 DEBUG [RS:0;jenkins-hbase4:37295] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 23:11:34,583 DEBUG [RS:1;jenkins-hbase4:43615] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 23:11:34,583 INFO [RS:1;jenkins-hbase4:43615] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 23:11:34,583 INFO [RS:1;jenkins-hbase4:43615] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 23:11:34,583 DEBUG [RS:0;jenkins-hbase4:37295] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 23:11:34,584 DEBUG [RS:0;jenkins-hbase4:37295] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 23:11:34,584 DEBUG [RS:0;jenkins-hbase4:37295] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 23:11:34,584 DEBUG [RS:0;jenkins-hbase4:37295] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:34,584 DEBUG [RS:0;jenkins-hbase4:37295] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37295,1689289892196' 2023-07-13 23:11:34,584 DEBUG [RS:0;jenkins-hbase4:37295] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:34,585 DEBUG [RS:0;jenkins-hbase4:37295] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:34,585 DEBUG [RS:0;jenkins-hbase4:37295] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 23:11:34,586 INFO [RS:0;jenkins-hbase4:37295] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 23:11:34,586 INFO [RS:0;jenkins-hbase4:37295] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 23:11:34,693 INFO [RS:1;jenkins-hbase4:43615] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43615%2C1689289892304, suffix=, logDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,43615,1689289892304, archiveDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/oldWALs, maxLogs=32 2023-07-13 23:11:34,694 INFO [RS:2;jenkins-hbase4:34053] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34053%2C1689289892354, suffix=, logDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,34053,1689289892354, archiveDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/oldWALs, maxLogs=32 2023-07-13 23:11:34,699 INFO [RS:0;jenkins-hbase4:37295] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37295%2C1689289892196, suffix=, logDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,37295,1689289892196, archiveDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/oldWALs, maxLogs=32 2023-07-13 23:11:34,714 DEBUG [jenkins-hbase4:46453] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-13 23:11:34,731 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK] 2023-07-13 23:11:34,732 DEBUG [jenkins-hbase4:46453] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:11:34,739 DEBUG [jenkins-hbase4:46453] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:11:34,739 DEBUG [jenkins-hbase4:46453] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:11:34,739 DEBUG [jenkins-hbase4:46453] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:11:34,739 DEBUG [jenkins-hbase4:46453] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:11:34,745 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK] 2023-07-13 23:11:34,750 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK] 2023-07-13 23:11:34,751 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43615,1689289892304, state=OPENING 2023-07-13 23:11:34,756 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK] 2023-07-13 23:11:34,756 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK] 2023-07-13 23:11:34,759 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK] 2023-07-13 23:11:34,759 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-13 23:11:34,760 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK] 2023-07-13 23:11:34,760 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK] 2023-07-13 23:11:34,761 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK] 2023-07-13 23:11:34,764 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:34,765 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-13 23:11:34,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:11:34,783 INFO [RS:1;jenkins-hbase4:43615] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,43615,1689289892304/jenkins-hbase4.apache.org%2C43615%2C1689289892304.1689289894701 2023-07-13 23:11:34,784 DEBUG [RS:1;jenkins-hbase4:43615] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK], DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK], DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK]] 2023-07-13 23:11:34,784 INFO [RS:2;jenkins-hbase4:34053] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,34053,1689289892354/jenkins-hbase4.apache.org%2C34053%2C1689289892354.1689289894701 2023-07-13 23:11:34,785 INFO [RS:0;jenkins-hbase4:37295] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,37295,1689289892196/jenkins-hbase4.apache.org%2C37295%2C1689289892196.1689289894701 2023-07-13 23:11:34,786 DEBUG [RS:2;jenkins-hbase4:34053] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK], DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK], DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK]] 2023-07-13 23:11:34,791 DEBUG [RS:0;jenkins-hbase4:37295] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK], DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK], DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK]] 2023-07-13 23:11:34,984 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:34,987 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:11:34,991 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:11:35,011 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-13 23:11:35,011 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:35,018 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43615%2C1689289892304.meta, suffix=.meta, logDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,43615,1689289892304, archiveDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/oldWALs, maxLogs=32 2023-07-13 23:11:35,047 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK] 2023-07-13 23:11:35,047 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK] 2023-07-13 23:11:35,047 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK] 2023-07-13 23:11:35,058 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/WALs/jenkins-hbase4.apache.org,43615,1689289892304/jenkins-hbase4.apache.org%2C43615%2C1689289892304.meta.1689289895020.meta 2023-07-13 23:11:35,059 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37555,DS-a5820b1d-9a4b-4594-b39a-61caf5969c19,DISK], DatanodeInfoWithStorage[127.0.0.1:44693,DS-eb60edf7-2efd-455f-9faa-c3acbc0ce772,DISK], DatanodeInfoWithStorage[127.0.0.1:40917,DS-952f632b-c442-470a-b2a1-7edfa7d6d644,DISK]] 2023-07-13 23:11:35,059 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:11:35,060 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-13 23:11:35,062 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:35,063 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-13 23:11:35,066 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-13 23:11:35,068 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-13 23:11:35,084 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-13 23:11:35,084 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:35,084 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-13 23:11:35,085 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-13 23:11:35,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-13 23:11:35,096 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/info 2023-07-13 23:11:35,096 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/info 2023-07-13 23:11:35,097 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-13 23:11:35,098 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:35,098 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-13 23:11:35,100 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/rep_barrier 2023-07-13 23:11:35,100 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/rep_barrier 2023-07-13 23:11:35,101 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-13 23:11:35,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:35,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-13 23:11:35,104 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/table 2023-07-13 23:11:35,104 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/table 2023-07-13 23:11:35,104 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-13 23:11:35,105 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:35,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740 2023-07-13 23:11:35,111 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740 2023-07-13 23:11:35,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-13 23:11:35,118 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-13 23:11:35,120 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70618130, jitterRate=0.05229213833808899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-13 23:11:35,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-13 23:11:35,145 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689289894973 2023-07-13 23:11:35,173 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-13 23:11:35,175 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-13 23:11:35,177 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43615,1689289892304, state=OPEN 2023-07-13 23:11:35,181 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-13 23:11:35,181 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-13 23:11:35,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-13 23:11:35,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43615,1689289892304 in 412 msec 2023-07-13 23:11:35,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-13 23:11:35,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 735 msec 2023-07-13 23:11:35,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2990 sec 2023-07-13 23:11:35,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689289895216, completionTime=-1 2023-07-13 23:11:35,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-13 23:11:35,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-13 23:11:35,311 DEBUG [hconnection-0x51c336ea-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:35,317 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:35,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-13 23:11:35,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689289955347 2023-07-13 23:11:35,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689290015347 2023-07-13 23:11:35,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 129 msec 2023-07-13 23:11:35,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46453,1689289890678-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46453,1689289890678-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46453,1689289890678-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46453, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,397 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-13 23:11:35,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-13 23:11:35,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 23:11:35,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-13 23:11:35,421 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:11:35,425 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:11:35,454 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:11:35,457 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b empty. 2023-07-13 23:11:35,457 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:11:35,458 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-13 23:11:35,503 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:35,506 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2572780f72ed08ee1d16faa85d9a322b, NAME => 'hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:11:35,524 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:35,524 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 2572780f72ed08ee1d16faa85d9a322b, disabling compactions & flushes 2023-07-13 23:11:35,525 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:11:35,525 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:11:35,525 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. after waiting 0 ms 2023-07-13 23:11:35,525 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:11:35,525 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:11:35,525 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 2572780f72ed08ee1d16faa85d9a322b: 2023-07-13 23:11:35,529 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:11:35,548 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689289895532"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289895532"}]},"ts":"1689289895532"} 2023-07-13 23:11:35,576 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-13 23:11:35,579 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:11:35,584 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289895579"}]},"ts":"1689289895579"} 2023-07-13 23:11:35,588 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-13 23:11:35,593 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:11:35,595 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:11:35,595 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:11:35,595 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:11:35,595 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:11:35,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2572780f72ed08ee1d16faa85d9a322b, ASSIGN}] 2023-07-13 23:11:35,600 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2572780f72ed08ee1d16faa85d9a322b, ASSIGN 2023-07-13 23:11:35,602 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2572780f72ed08ee1d16faa85d9a322b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34053,1689289892354; forceNewPlan=false, retain=false 2023-07-13 23:11:35,755 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 23:11:35,756 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2572780f72ed08ee1d16faa85d9a322b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:35,756 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689289895756"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289895756"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289895756"}]},"ts":"1689289895756"} 2023-07-13 23:11:35,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2572780f72ed08ee1d16faa85d9a322b, server=jenkins-hbase4.apache.org,34053,1689289892354}] 2023-07-13 23:11:35,913 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:35,913 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:11:35,917 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:11:35,923 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:11:35,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2572780f72ed08ee1d16faa85d9a322b, NAME => 'hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b.', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:11:35,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. service=AccessControlService 2023-07-13 23:11:35,924 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:35,925 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:11:35,925 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:35,925 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:11:35,925 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:11:35,928 INFO [StoreOpener-2572780f72ed08ee1d16faa85d9a322b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:11:35,930 DEBUG [StoreOpener-2572780f72ed08ee1d16faa85d9a322b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b/info 2023-07-13 23:11:35,930 DEBUG [StoreOpener-2572780f72ed08ee1d16faa85d9a322b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b/info 2023-07-13 23:11:35,931 INFO [StoreOpener-2572780f72ed08ee1d16faa85d9a322b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2572780f72ed08ee1d16faa85d9a322b columnFamilyName info 2023-07-13 23:11:35,932 INFO [StoreOpener-2572780f72ed08ee1d16faa85d9a322b-1] regionserver.HStore(310): Store=2572780f72ed08ee1d16faa85d9a322b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:35,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:11:35,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:11:35,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:11:35,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:35,944 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2572780f72ed08ee1d16faa85d9a322b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70990368, jitterRate=0.05783891677856445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:35,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2572780f72ed08ee1d16faa85d9a322b: 2023-07-13 23:11:35,947 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b., pid=6, masterSystemTime=1689289895913 2023-07-13 23:11:35,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:11:35,952 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:11:35,953 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2572780f72ed08ee1d16faa85d9a322b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:35,953 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689289895952"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289895952"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289895952"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289895952"}]},"ts":"1689289895952"} 2023-07-13 23:11:35,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-13 23:11:35,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2572780f72ed08ee1d16faa85d9a322b, server=jenkins-hbase4.apache.org,34053,1689289892354 in 199 msec 2023-07-13 23:11:35,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-13 23:11:35,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2572780f72ed08ee1d16faa85d9a322b, ASSIGN in 365 msec 2023-07-13 23:11:35,967 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:11:35,967 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289895967"}]},"ts":"1689289895967"} 2023-07-13 23:11:35,969 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-13 23:11:35,973 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:11:35,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 566 msec 2023-07-13 23:11:36,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-13 23:11:36,024 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-13 23:11:36,024 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:36,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:36,050 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:36,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-13 23:11:36,082 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-13 23:11:36,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-13 23:11:36,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-13 23:11:36,113 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-13 23:11:36,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-13 23:11:36,137 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-13 23:11:36,140 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-13 23:11:36,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.693sec 2023-07-13 23:11:36,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-13 23:11:36,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-13 23:11:36,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-13 23:11:36,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46453,1689289890678-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-13 23:11:36,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46453,1689289890678-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-13 23:11:36,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 23:11:36,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-13 23:11:36,183 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:11:36,185 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:11:36,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-13 23:11:36,188 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:11:36,189 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9 empty. 2023-07-13 23:11:36,192 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:11:36,192 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-13 23:11:36,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 23:11:36,221 DEBUG [Listener at localhost/39383] zookeeper.ReadOnlyZKClient(139): Connect 0x5577d993 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:36,236 DEBUG [Listener at localhost/39383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49622dd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:36,245 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:36,247 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => b471ba8553f5b202f8c4c8eba9c2b9e9, NAME => 'hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:11:36,257 DEBUG [hconnection-0x4b6a6c9c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:36,280 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:36,284 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:36,284 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing b471ba8553f5b202f8c4c8eba9c2b9e9, disabling compactions & flushes 2023-07-13 23:11:36,284 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:11:36,284 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:11:36,284 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. after waiting 0 ms 2023-07-13 23:11:36,284 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:11:36,284 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:11:36,285 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for b471ba8553f5b202f8c4c8eba9c2b9e9: 2023-07-13 23:11:36,285 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:11:36,285 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-13 23:11:36,286 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/test.cache.data in system properties and HBase conf 2023-07-13 23:11:36,286 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop.tmp.dir in system properties and HBase conf 2023-07-13 23:11:36,286 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop.log.dir in system properties and HBase conf 2023-07-13 23:11:36,286 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-13 23:11:36,286 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-13 23:11:36,286 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-13 23:11:36,286 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-13 23:11:36,287 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-13 23:11:36,287 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-13 23:11:36,287 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 23:11:36,287 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-13 23:11:36,287 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-13 23:11:36,287 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 23:11:36,287 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 23:11:36,288 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-13 23:11:36,288 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/nfs.dump.dir in system properties and HBase conf 2023-07-13 23:11:36,288 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir in system properties and HBase conf 2023-07-13 23:11:36,288 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 23:11:36,288 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-13 23:11:36,288 INFO [Listener at localhost/39383] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-13 23:11:36,289 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:11:36,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689289896290"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289896290"}]},"ts":"1689289896290"} 2023-07-13 23:11:36,293 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-13 23:11:36,295 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:11:36,295 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289896295"}]},"ts":"1689289896295"} 2023-07-13 23:11:36,297 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-13 23:11:36,301 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:11:36,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 23:11:36,302 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:11:36,303 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:11:36,303 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:11:36,303 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:11:36,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b471ba8553f5b202f8c4c8eba9c2b9e9, ASSIGN}] 2023-07-13 23:11:36,305 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b471ba8553f5b202f8c4c8eba9c2b9e9, ASSIGN 2023-07-13 23:11:36,308 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=b471ba8553f5b202f8c4c8eba9c2b9e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37295,1689289892196; forceNewPlan=false, retain=false 2023-07-13 23:11:36,458 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 23:11:36,460 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b471ba8553f5b202f8c4c8eba9c2b9e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:36,460 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689289896459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289896459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289896459"}]},"ts":"1689289896459"} 2023-07-13 23:11:36,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure b471ba8553f5b202f8c4c8eba9c2b9e9, server=jenkins-hbase4.apache.org,37295,1689289892196}] 2023-07-13 23:11:36,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 23:11:36,619 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:36,619 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:11:36,623 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:11:36,633 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:11:36,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b471ba8553f5b202f8c4c8eba9c2b9e9, NAME => 'hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9.', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:11:36,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. service=AccessControlService 2023-07-13 23:11:36,635 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:36,635 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:11:36,635 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:36,635 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:11:36,635 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:11:36,647 INFO [StoreOpener-b471ba8553f5b202f8c4c8eba9c2b9e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:11:36,649 DEBUG [StoreOpener-b471ba8553f5b202f8c4c8eba9c2b9e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9/l 2023-07-13 23:11:36,649 DEBUG [StoreOpener-b471ba8553f5b202f8c4c8eba9c2b9e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9/l 2023-07-13 23:11:36,650 INFO [StoreOpener-b471ba8553f5b202f8c4c8eba9c2b9e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b471ba8553f5b202f8c4c8eba9c2b9e9 columnFamilyName l 2023-07-13 23:11:36,651 INFO [StoreOpener-b471ba8553f5b202f8c4c8eba9c2b9e9-1] regionserver.HStore(310): Store=b471ba8553f5b202f8c4c8eba9c2b9e9/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:36,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:11:36,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:11:36,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:11:36,668 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:36,669 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b471ba8553f5b202f8c4c8eba9c2b9e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75042292, jitterRate=0.11821728944778442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:36,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b471ba8553f5b202f8c4c8eba9c2b9e9: 2023-07-13 23:11:36,671 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9., pid=11, masterSystemTime=1689289896619 2023-07-13 23:11:36,677 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:11:36,678 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:11:36,679 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b471ba8553f5b202f8c4c8eba9c2b9e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:36,679 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689289896678"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289896678"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289896678"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289896678"}]},"ts":"1689289896678"} 2023-07-13 23:11:36,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-13 23:11:36,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure b471ba8553f5b202f8c4c8eba9c2b9e9, server=jenkins-hbase4.apache.org,37295,1689289892196 in 218 msec 2023-07-13 23:11:36,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-13 23:11:36,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=b471ba8553f5b202f8c4c8eba9c2b9e9, ASSIGN in 384 msec 2023-07-13 23:11:36,693 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:11:36,693 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289896693"}]},"ts":"1689289896693"} 2023-07-13 23:11:36,696 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-13 23:11:36,700 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:11:36,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 527 msec 2023-07-13 23:11:36,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 23:11:36,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-13 23:11:36,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-13 23:11:37,778 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:38,161 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:38,170 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41905_jobhistory____7uvfm2/webapp 2023-07-13 23:11:38,399 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-13 23:11:38,399 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-13 23:11:38,399 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 23:11:38,404 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 23:11:38,496 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:38,863 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:39,448 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-13 23:11:39,500 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41905 2023-07-13 23:11:40,641 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:11:40,967 WARN [Listener at jenkins-hbase4.apache.org/43599] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:41,009 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-13 23:11:41,011 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-13 23:11:41,012 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-13 23:11:41,013 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:11:41,014 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-13 23:11:41,014 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:11:41,015 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-13 23:11:41,015 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-13 23:11:41,015 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-13 23:11:41,015 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:11:41,015 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-13 23:11:41,015 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-13 23:11:41,015 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-13 23:11:41,086 WARN [Listener at jenkins-hbase4.apache.org/43599] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 23:11:41,087 INFO [Listener at jenkins-hbase4.apache.org/43599] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:41,098 INFO [Listener at jenkins-hbase4.apache.org/43599] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39983_cluster____kzc8ie/webapp 2023-07-13 23:11:41,193 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 23:11:41,193 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-13 23:11:41,193 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 23:11:41,194 INFO [Listener at jenkins-hbase4.apache.org/43599] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 23:11:41,205 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:41,417 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:41,528 INFO [Listener at jenkins-hbase4.apache.org/43599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:41,539 INFO [Listener at jenkins-hbase4.apache.org/43599] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39983 2023-07-13 23:11:42,113 WARN [Listener at jenkins-hbase4.apache.org/38275] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:42,149 WARN [Listener at jenkins-hbase4.apache.org/38275] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 23:11:42,150 INFO [Listener at jenkins-hbase4.apache.org/38275] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:42,162 INFO [Listener at jenkins-hbase4.apache.org/38275] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35413_node____.7d4efi/webapp 2023-07-13 23:11:42,240 INFO [Listener at jenkins-hbase4.apache.org/38275] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-13 23:11:42,241 INFO [Listener at jenkins-hbase4.apache.org/38275] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 23:11:42,241 INFO [Listener at jenkins-hbase4.apache.org/38275] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 23:11:42,241 INFO [Listener at jenkins-hbase4.apache.org/38275] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 23:11:42,252 INFO [Listener at jenkins-hbase4.apache.org/38275] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,287 INFO [Listener at jenkins-hbase4.apache.org/38275] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,405 INFO [Listener at jenkins-hbase4.apache.org/38275] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,419 INFO [Listener at jenkins-hbase4.apache.org/38275] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35413 2023-07-13 23:11:42,677 WARN [Listener at jenkins-hbase4.apache.org/35127] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:42,683 WARN [Listener at jenkins-hbase4.apache.org/35127] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 23:11:42,683 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:42,692 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38365_node____nr6r57/webapp 2023-07-13 23:11:42,747 INFO [Listener at jenkins-hbase4.apache.org/35127] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-13 23:11:42,748 INFO [Listener at jenkins-hbase4.apache.org/35127] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 23:11:42,748 INFO [Listener at jenkins-hbase4.apache.org/35127] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 23:11:42,748 INFO [Listener at jenkins-hbase4.apache.org/35127] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 23:11:42,758 INFO [Listener at jenkins-hbase4.apache.org/35127] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,775 INFO [Listener at jenkins-hbase4.apache.org/35127] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,875 INFO [Listener at jenkins-hbase4.apache.org/35127] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,883 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38365 2023-07-13 23:11:42,914 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-13 23:11:42,915 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:11:42,982 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=196, ProcessCount=175, AvailableMemoryMB=5860 2023-07-13 23:11:42,982 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-13 23:11:43,000 DEBUG [Listener at jenkins-hbase4.apache.org/35127] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-13 23:11:43,008 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-13 23:11:43,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 23:11:43,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:11:43,023 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:11:43,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-13 23:11:43,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:43,026 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:11:43,031 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795 2023-07-13 23:11:43,031 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:11:43,032 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795 empty. 2023-07-13 23:11:43,036 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9 empty. 2023-07-13 23:11:43,037 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795 2023-07-13 23:11:43,037 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:11:43,037 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-13 23:11:43,075 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:43,080 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5a3b1717f1eee2de3119907439738795, NAME => 'testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:11:43,081 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 811a6fb5a65e4488837d8e0f062efdc9, NAME => 'testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:11:43,122 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:43,123 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5a3b1717f1eee2de3119907439738795, disabling compactions & flushes 2023-07-13 23:11:43,123 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:43,123 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:43,123 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. after waiting 0 ms 2023-07-13 23:11:43,123 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:43,123 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:43,124 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5a3b1717f1eee2de3119907439738795: 2023-07-13 23:11:43,125 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:43,125 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 811a6fb5a65e4488837d8e0f062efdc9, disabling compactions & flushes 2023-07-13 23:11:43,125 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:43,125 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:43,125 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. after waiting 0 ms 2023-07-13 23:11:43,125 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:43,126 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:43,126 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 811a6fb5a65e4488837d8e0f062efdc9: 2023-07-13 23:11:43,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:43,129 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:11:43,131 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289903130"}]},"ts":"1689289903130"} 2023-07-13 23:11:43,131 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289903130"}]},"ts":"1689289903130"} 2023-07-13 23:11:43,187 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:11:43,188 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:11:43,189 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289903188"}]},"ts":"1689289903188"} 2023-07-13 23:11:43,191 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-13 23:11:43,197 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:11:43,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:11:43,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:11:43,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:11:43,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:11:43,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a3b1717f1eee2de3119907439738795, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=811a6fb5a65e4488837d8e0f062efdc9, ASSIGN}] 2023-07-13 23:11:43,203 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a3b1717f1eee2de3119907439738795, ASSIGN 2023-07-13 23:11:43,203 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=811a6fb5a65e4488837d8e0f062efdc9, ASSIGN 2023-07-13 23:11:43,204 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a3b1717f1eee2de3119907439738795, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37295,1689289892196; forceNewPlan=false, retain=false 2023-07-13 23:11:43,204 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=811a6fb5a65e4488837d8e0f062efdc9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43615,1689289892304; forceNewPlan=false, retain=false 2023-07-13 23:11:43,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:43,355 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:11:43,357 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=811a6fb5a65e4488837d8e0f062efdc9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:43,357 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5a3b1717f1eee2de3119907439738795, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:43,358 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289903357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289903357"}]},"ts":"1689289903357"} 2023-07-13 23:11:43,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289903357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289903357"}]},"ts":"1689289903357"} 2023-07-13 23:11:43,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 811a6fb5a65e4488837d8e0f062efdc9, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:11:43,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 5a3b1717f1eee2de3119907439738795, server=jenkins-hbase4.apache.org,37295,1689289892196}] 2023-07-13 23:11:43,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:43,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 811a6fb5a65e4488837d8e0f062efdc9, NAME => 'testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:11:43,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. service=AccessControlService 2023-07-13 23:11:43,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:43,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:11:43,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:43,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:11:43,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:11:43,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:43,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a3b1717f1eee2de3119907439738795, NAME => 'testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:11:43,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. service=AccessControlService 2023-07-13 23:11:43,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:43,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5a3b1717f1eee2de3119907439738795 2023-07-13 23:11:43,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:43,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5a3b1717f1eee2de3119907439738795 2023-07-13 23:11:43,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5a3b1717f1eee2de3119907439738795 2023-07-13 23:11:43,545 INFO [StoreOpener-5a3b1717f1eee2de3119907439738795-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5a3b1717f1eee2de3119907439738795 2023-07-13 23:11:43,545 INFO [StoreOpener-811a6fb5a65e4488837d8e0f062efdc9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:11:43,547 DEBUG [StoreOpener-811a6fb5a65e4488837d8e0f062efdc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/cf 2023-07-13 23:11:43,547 DEBUG [StoreOpener-811a6fb5a65e4488837d8e0f062efdc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/cf 2023-07-13 23:11:43,548 DEBUG [StoreOpener-5a3b1717f1eee2de3119907439738795-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/cf 2023-07-13 23:11:43,548 DEBUG [StoreOpener-5a3b1717f1eee2de3119907439738795-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/cf 2023-07-13 23:11:43,551 INFO [StoreOpener-811a6fb5a65e4488837d8e0f062efdc9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 811a6fb5a65e4488837d8e0f062efdc9 columnFamilyName cf 2023-07-13 23:11:43,553 INFO [StoreOpener-5a3b1717f1eee2de3119907439738795-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a3b1717f1eee2de3119907439738795 columnFamilyName cf 2023-07-13 23:11:43,555 INFO [StoreOpener-811a6fb5a65e4488837d8e0f062efdc9-1] regionserver.HStore(310): Store=811a6fb5a65e4488837d8e0f062efdc9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:43,557 INFO [StoreOpener-5a3b1717f1eee2de3119907439738795-1] regionserver.HStore(310): Store=5a3b1717f1eee2de3119907439738795/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:43,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:11:43,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795 2023-07-13 23:11:43,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:11:43,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795 2023-07-13 23:11:43,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5a3b1717f1eee2de3119907439738795 2023-07-13 23:11:43,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:11:43,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:43,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:43,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5a3b1717f1eee2de3119907439738795; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69920185, jitterRate=0.04189194738864899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:43,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5a3b1717f1eee2de3119907439738795: 2023-07-13 23:11:43,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795., pid=16, masterSystemTime=1689289903528 2023-07-13 23:11:43,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 811a6fb5a65e4488837d8e0f062efdc9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60744039, jitterRate=-0.09484328329563141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:43,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 811a6fb5a65e4488837d8e0f062efdc9: 2023-07-13 23:11:43,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9., pid=15, masterSystemTime=1689289903524 2023-07-13 23:11:43,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:43,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:43,596 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5a3b1717f1eee2de3119907439738795, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:43,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:43,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:43,597 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903596"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289903596"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289903596"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289903596"}]},"ts":"1689289903596"} 2023-07-13 23:11:43,598 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=811a6fb5a65e4488837d8e0f062efdc9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:43,598 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289903597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289903597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289903597"}]},"ts":"1689289903597"} 2023-07-13 23:11:43,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-13 23:11:43,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 5a3b1717f1eee2de3119907439738795, server=jenkins-hbase4.apache.org,37295,1689289892196 in 226 msec 2023-07-13 23:11:43,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-13 23:11:43,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 811a6fb5a65e4488837d8e0f062efdc9, server=jenkins-hbase4.apache.org,43615,1689289892304 in 235 msec 2023-07-13 23:11:43,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=811a6fb5a65e4488837d8e0f062efdc9, ASSIGN in 413 msec 2023-07-13 23:11:43,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-13 23:11:43,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a3b1717f1eee2de3119907439738795, ASSIGN in 413 msec 2023-07-13 23:11:43,618 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:11:43,618 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289903618"}]},"ts":"1689289903618"} 2023-07-13 23:11:43,620 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-13 23:11:43,623 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:11:43,629 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-13 23:11:43,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:43,635 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:43,639 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:43,643 DEBUG [hconnection-0x1e8d6bd8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:43,645 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-13 23:11:43,656 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 23:11:43,689 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 23:11:43,689 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 23:11:43,689 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 23:11:43,690 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 23:11:43,690 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:43,698 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:11:43,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 23:11:43,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 23:11:43,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 23:11:43,699 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 23:11:43,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 684 msec 2023-07-13 23:11:44,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:44,133 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-13 23:11:44,138 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-13 23:11:44,139 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:44,141 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:11:44,169 DEBUG [hconnection-0x4b6a6c9c-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,173 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289904193 (current time:1689289904193). 2023-07-13 23:11:44,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:11:44,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x482a1d96 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:44,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17862b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:44,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,206 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x482a1d96 to 127.0.0.1:63739 2023-07-13 23:11:44,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:11:44,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x1c4a277f to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:44,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e4ed8e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:44,225 DEBUG [hconnection-0x63308963-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,226 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,233 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c4a277f to 127.0.0.1:63739 2023-07-13 23:11:44,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:11:44,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 23:11:44,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:11:44,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:44,289 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:44,290 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689290504290 2023-07-13 23:11:44,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,291 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-13 23:11:44,294 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:44,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:44,298 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:11:44,298 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:11:44,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-13 23:11:44,301 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:44,302 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689290504302 2023-07-13 23:11:44,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,343 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-13 23:11:44,343 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:44,345 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-13 23:11:44,345 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-13 23:11:44,346 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,346 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,350 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,350 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,350 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,350 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,351 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,351 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,352 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 23:11:44,352 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:11:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 23:11:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 23:11:44,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:44,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:44,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,357 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:44,357 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:44,357 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:44,357 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:44,357 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:44,358 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:44,359 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:44,359 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:44,359 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:44,359 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:44,359 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:44,359 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:44,359 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:44,359 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:44,359 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:44,362 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,363 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,364 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,364 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,364 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,365 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,365 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:44,365 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,365 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,365 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,366 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-13 23:11:44,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37fe197[Count = 1] remaining members to acquire global barrier 2023-07-13 23:11:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-13 23:11:44,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37fe197[Count = 0] remaining members to acquire global barrier 2023-07-13 23:11:44,375 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-13 23:11:44,375 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,377 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,377 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,377 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,378 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:44,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:44,378 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:11:44,378 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:11:44,379 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:11:44,379 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:44,379 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:11:44,380 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. started... 2023-07-13 23:11:44,382 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a3b1717f1eee2de3119907439738795: 2023-07-13 23:11:44,383 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,384 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:11:44,388 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:11:44,388 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:44,388 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. started... 2023-07-13 23:11:44,388 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:44,388 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:44,390 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:44,393 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 811a6fb5a65e4488837d8e0f062efdc9: 2023-07-13 23:11:44,394 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,396 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:11:44,396 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:11:44,398 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:44,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:44,401 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:11:44,401 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:11:44,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:11:44,403 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:11:44,448 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. completed. 2023-07-13 23:11:44,448 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:44,448 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:11:44,449 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:11:44,449 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,449 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:44,449 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:11:44,451 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:44,451 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,451 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,451 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37295,1689289892196': 2023-07-13 23:11:44,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-13 23:11:44,461 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. completed. 2023-07-13 23:11:44,461 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:44,461 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:11:44,461 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:11:44,461 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,461 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:44,461 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:11:44,464 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:44,464 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,464 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:44,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,464 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:44,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:11:44,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-13 23:11:44,472 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-13 23:11:44,472 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:11:44,472 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:11:44,472 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,472 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:11:44,475 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,475 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,475 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,475 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,475 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,475 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,475 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,476 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,477 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,477 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,480 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,481 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,481 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,503 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,503 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,503 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,504 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,503 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,504 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,504 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,504 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,504 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-13 23:11:44,504 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,504 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:11:44,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,504 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:44,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,505 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,507 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,507 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:44,507 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:44,507 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,507 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 23:11:44,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,604 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:44,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:44,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:11:44,606 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:11:44,638 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-13 23:11:44,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,639 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689289904291Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689289904538 (+247 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689289904538Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689289904539 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689289904561 (+22 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689289904593 (+32 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689289904638 (+45 ms) 2023-07-13 23:11:44,641 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:44,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 349 msec 2023-07-13 23:11:44,906 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:44,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:44,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:11:44,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37295] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:11:44,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43615] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:11:44,932 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-13 23:11:44,933 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:44,933 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:11:44,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289904950 (current time:1689289904950). 2023-07-13 23:11:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:11:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x705cb687 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:44,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2aafe45d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:44,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,961 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x705cb687 to 127.0.0.1:63739 2023-07-13 23:11:44,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:11:44,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x6d0eba2f to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:44,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78f3c187, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:44,983 DEBUG [hconnection-0x2d2b5fc8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,986 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,994 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d0eba2f to 127.0.0.1:63739 2023-07-13 23:11:44,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:11:44,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 23:11:44,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:11:44,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:45,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:45,003 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:45,006 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689290505006 2023-07-13 23:11:45,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-13 23:11:45,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:45,007 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:11:45,007 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:11:45,013 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:45,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:45,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-13 23:11:45,016 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:45,017 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689290505017 2023-07-13 23:11:45,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-13 23:11:45,055 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-13 23:11:45,055 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:45,056 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-13 23:11:45,056 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-13 23:11:45,057 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,057 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,058 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,058 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,059 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,059 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,059 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,059 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,060 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,060 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:11:45,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 23:11:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,061 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 23:11:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,062 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 23:11:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,063 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:45,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 23:11:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:45,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 23:11:45,071 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:45,071 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:45,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 23:11:45,071 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:45,078 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,078 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,078 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,078 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:45,081 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-13 23:11:45,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48cfb658[Count = 1] remaining members to acquire global barrier 2023-07-13 23:11:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-13 23:11:45,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48cfb658[Count = 0] remaining members to acquire global barrier 2023-07-13 23:11:45,088 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-13 23:11:45,088 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,091 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,091 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,091 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,092 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:45,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:11:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,092 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:45,092 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:11:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:11:45,093 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:11:45,093 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:45,093 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:45,093 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. started... 2023-07-13 23:11:45,093 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:11:45,093 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:11:45,093 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. started... 2023-07-13 23:11:45,093 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5a3b1717f1eee2de3119907439738795 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-13 23:11:45,093 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 811a6fb5a65e4488837d8e0f062efdc9 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-13 23:11:45,096 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:45,096 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:45,096 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:45,107 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:45,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:45,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:11:45,109 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:11:45,253 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307136657338796024e2e8d0b43b763289ddb to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307136657338796024e2e8d0b43b763289ddb 2023-07-13 23:11:45,254 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307138a16eff5d8504f4089d1d68671c3400d to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307138a16eff5d8504f4089d1d68671c3400d 2023-07-13 23:11:45,300 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/.tmp/cf/784be5b66cfe460598a65c6f9b7e7b63 2023-07-13 23:11:45,302 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/.tmp/cf/86b3d632e1cf47d99c158899e524aed1 2023-07-13 23:11:45,309 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:45,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:45,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:11:45,312 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:11:45,316 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/.tmp/cf/784be5b66cfe460598a65c6f9b7e7b63 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/cf/784be5b66cfe460598a65c6f9b7e7b63 2023-07-13 23:11:45,319 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/.tmp/cf/86b3d632e1cf47d99c158899e524aed1 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/cf/86b3d632e1cf47d99c158899e524aed1 2023-07-13 23:11:45,330 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/cf/784be5b66cfe460598a65c6f9b7e7b63, entries=2, sequenceid=6, filesize=5.2 K 2023-07-13 23:11:45,333 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/cf/86b3d632e1cf47d99c158899e524aed1, entries=48, sequenceid=6, filesize=13.0 K 2023-07-13 23:11:45,338 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 5a3b1717f1eee2de3119907439738795 in 245ms, sequenceid=6, compaction requested=false 2023-07-13 23:11:45,341 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-13 23:11:45,343 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 811a6fb5a65e4488837d8e0f062efdc9 in 250ms, sequenceid=6, compaction requested=false 2023-07-13 23:11:45,343 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a3b1717f1eee2de3119907439738795: 2023-07-13 23:11:45,344 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 23:11:45,344 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:11:45,344 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/cf/784be5b66cfe460598a65c6f9b7e7b63] hfiles 2023-07-13 23:11:45,344 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/cf/784be5b66cfe460598a65c6f9b7e7b63 for snapshot=snaptb0-testExportWithTargetName 2023-07-13 23:11:45,352 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 811a6fb5a65e4488837d8e0f062efdc9: 2023-07-13 23:11:45,353 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 23:11:45,353 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:11:45,353 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/cf/86b3d632e1cf47d99c158899e524aed1] hfiles 2023-07-13 23:11:45,353 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/cf/86b3d632e1cf47d99c158899e524aed1 for snapshot=snaptb0-testExportWithTargetName 2023-07-13 23:11:45,388 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. completed. 2023-07-13 23:11:45,388 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:11:45,388 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:11:45,388 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:11:45,388 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,388 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:45,388 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:11:45,390 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,390 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:45,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,390 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:45,391 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:45,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,393 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. completed. 2023-07-13 23:11:45,393 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:11:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:11:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:11:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:45,393 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:11:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,395 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:45,395 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:45,395 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:45,395 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:11:45,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-13 23:11:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37295,1689289892196': 2023-07-13 23:11:45,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-13 23:11:45,405 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-13 23:11:45,406 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:11:45,406 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:11:45,406 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-13 23:11:45,406 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:11:45,408 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,408 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,408 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,408 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,408 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,409 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,409 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,410 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,414 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,415 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,419 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,419 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,420 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,433 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,433 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,433 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,433 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,433 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,433 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,434 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:45,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,433 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,434 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-13 23:11:45,433 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-13 23:11:45,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,435 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,435 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,435 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:11:45,435 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,435 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:11:45,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 23:11:45,435 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:11:45,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:11:45,436 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,436 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307138a16eff5d8504f4089d1d68671c3400d, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307136657338796024e2e8d0b43b763289ddb] mob files 2023-07-13 23:11:45,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307138a16eff5d8504f4089d1d68671c3400d 2023-07-13 23:11:45,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307136657338796024e2e8d0b43b763289ddb 2023-07-13 23:11:45,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-13 23:11:45,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,534 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-13 23:11:45,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,535 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689289905006Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689289905463 (+457 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689289905463Loading Region manifests for snaptb0-testExportWithTargetName at 1689289905463Writing data manifest for snaptb0-testExportWithTargetName at 1689289905469 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689289905489 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689289905534 (+45 ms) 2023-07-13 23:11:45,537 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:45,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 526 msec 2023-07-13 23:11:45,612 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:45,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:45,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:11:45,616 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615 2023-07-13 23:11:45,616 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33689, tgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615, rawTgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615, srcFsUri=hdfs://localhost:33689, srcDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:11:45,666 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:11:45,666 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659128655_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-13 23:11:45,666 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29, snapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-13 23:11:45,694 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-13 23:11:46,236 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,236 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,237 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,237 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:47,238 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-2821715230726657241.jar 2023-07-13 23:11:47,239 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:47,251 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:47,354 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-803125465927326180.jar 2023-07-13 23:11:47,355 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:47,356 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:47,357 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:47,358 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:47,358 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:47,359 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:47,359 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:11:47,360 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:11:47,360 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:11:47,361 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:11:47,362 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:11:47,362 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:11:47,363 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:11:47,363 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:11:47,364 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:11:47,365 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:11:47,369 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:11:47,370 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:11:47,370 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:11:47,371 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:11:47,371 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:11:47,372 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:11:47,372 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:11:48,494 WARN [Listener at jenkins-hbase4.apache.org/35127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:11:48,501 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-13 23:11:48,511 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-13 23:11:49,046 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:11:49,048 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:11:49,055 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:11:49,780 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0001_000001 (auth:SIMPLE) 2023-07-13 23:11:55,164 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0001_000001 (auth:SIMPLE) 2023-07-13 23:11:57,462 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0001_000001 (auth:SIMPLE) 2023-07-13 23:12:00,632 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0001_000001 (auth:SIMPLE) 2023-07-13 23:12:02,524 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:12:02,526 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:12:02,537 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-13 23:12:02,537 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:12:02,538 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:12:02,538 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-13 23:12:02,539 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-13 23:12:02,539 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-13 23:12:02,539 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615/.hbase-snapshot/testExportWithTargetName 2023-07-13 23:12:02,539 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-13 23:12:02,539 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289905615/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-13 23:12:02,550 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-13 23:12:02,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-13 23:12:02,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:02,566 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289922566"}]},"ts":"1689289922566"} 2023-07-13 23:12:02,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 23:12:02,568 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-13 23:12:02,571 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-13 23:12:02,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a3b1717f1eee2de3119907439738795, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=811a6fb5a65e4488837d8e0f062efdc9, UNASSIGN}] 2023-07-13 23:12:02,575 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a3b1717f1eee2de3119907439738795, UNASSIGN 2023-07-13 23:12:02,575 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=811a6fb5a65e4488837d8e0f062efdc9, UNASSIGN 2023-07-13 23:12:02,576 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5a3b1717f1eee2de3119907439738795, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:02,576 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=811a6fb5a65e4488837d8e0f062efdc9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:02,576 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289922576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289922576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289922576"}]},"ts":"1689289922576"} 2023-07-13 23:12:02,576 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289922576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289922576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289922576"}]},"ts":"1689289922576"} 2023-07-13 23:12:02,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 811a6fb5a65e4488837d8e0f062efdc9, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:12:02,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 5a3b1717f1eee2de3119907439738795, server=jenkins-hbase4.apache.org,37295,1689289892196}] 2023-07-13 23:12:02,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 23:12:02,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5a3b1717f1eee2de3119907439738795 2023-07-13 23:12:02,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:12:02,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5a3b1717f1eee2de3119907439738795, disabling compactions & flushes 2023-07-13 23:12:02,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 811a6fb5a65e4488837d8e0f062efdc9, disabling compactions & flushes 2023-07-13 23:12:02,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:12:02,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:12:02,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:12:02,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:12:02,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. after waiting 0 ms 2023-07-13 23:12:02,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. after waiting 0 ms 2023-07-13 23:12:02,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:12:02,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:12:02,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:02,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:02,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:02,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9. 2023-07-13 23:12:02,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 811a6fb5a65e4488837d8e0f062efdc9: 2023-07-13 23:12:02,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:02,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795. 2023-07-13 23:12:02,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5a3b1717f1eee2de3119907439738795: 2023-07-13 23:12:02,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:12:02,759 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=811a6fb5a65e4488837d8e0f062efdc9, regionState=CLOSED 2023-07-13 23:12:02,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5a3b1717f1eee2de3119907439738795 2023-07-13 23:12:02,759 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289922759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289922759"}]},"ts":"1689289922759"} 2023-07-13 23:12:02,759 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5a3b1717f1eee2de3119907439738795, regionState=CLOSED 2023-07-13 23:12:02,760 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289922759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289922759"}]},"ts":"1689289922759"} 2023-07-13 23:12:02,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-13 23:12:02,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 811a6fb5a65e4488837d8e0f062efdc9, server=jenkins-hbase4.apache.org,43615,1689289892304 in 183 msec 2023-07-13 23:12:02,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-13 23:12:02,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 5a3b1717f1eee2de3119907439738795, server=jenkins-hbase4.apache.org,37295,1689289892196 in 184 msec 2023-07-13 23:12:02,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=811a6fb5a65e4488837d8e0f062efdc9, UNASSIGN in 190 msec 2023-07-13 23:12:02,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-13 23:12:02,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a3b1717f1eee2de3119907439738795, UNASSIGN in 191 msec 2023-07-13 23:12:02,768 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289922768"}]},"ts":"1689289922768"} 2023-07-13 23:12:02,769 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-13 23:12:02,772 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-13 23:12:02,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 216 msec 2023-07-13 23:12:02,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 23:12:02,871 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-13 23:12:02,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-13 23:12:02,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:02,888 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:02,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-13 23:12:02,893 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:02,896 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-13 23:12:02,900 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:02,900 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:02,900 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:02,900 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:02,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-13 23:12:02,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-13 23:12:02,901 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:02,901 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:02,901 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:02,901 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:02,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 23:12:02,902 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:12:02,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 23:12:02,902 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:12:02,901 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:02,903 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:02,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-13 23:12:02,905 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795 2023-07-13 23:12:02,911 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:12:02,916 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/recovered.edits] 2023-07-13 23:12:02,916 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/recovered.edits] 2023-07-13 23:12:02,928 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/cf/86b3d632e1cf47d99c158899e524aed1 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/cf/86b3d632e1cf47d99c158899e524aed1 2023-07-13 23:12:02,928 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/cf/784be5b66cfe460598a65c6f9b7e7b63 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/cf/784be5b66cfe460598a65c6f9b7e7b63 2023-07-13 23:12:02,935 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9/recovered.edits/9.seqid 2023-07-13 23:12:02,936 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795/recovered.edits/9.seqid 2023-07-13 23:12:02,937 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/5a3b1717f1eee2de3119907439738795 2023-07-13 23:12:02,937 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportWithTargetName/811a6fb5a65e4488837d8e0f062efdc9 2023-07-13 23:12:02,937 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-13 23:12:02,938 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-13 23:12:02,940 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-13 23:12:02,945 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307138a16eff5d8504f4089d1d68671c3400d to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307138a16eff5d8504f4089d1d68671c3400d 2023-07-13 23:12:02,948 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307136657338796024e2e8d0b43b763289ddb to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307136657338796024e2e8d0b43b763289ddb 2023-07-13 23:12:02,948 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-13 23:12:02,952 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:02,976 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-13 23:12:02,980 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-13 23:12:02,982 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:02,982 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-13 23:12:02,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289922982"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:02,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289922982"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:02,988 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:12:02,988 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5a3b1717f1eee2de3119907439738795, NAME => 'testtb-testExportWithTargetName,,1689289903016.5a3b1717f1eee2de3119907439738795.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 811a6fb5a65e4488837d8e0f062efdc9, NAME => 'testtb-testExportWithTargetName,1,1689289903016.811a6fb5a65e4488837d8e0f062efdc9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:12:02,988 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-13 23:12:02,989 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289922988"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:02,993 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-13 23:12:02,999 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:03,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 121 msec 2023-07-13 23:12:03,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-13 23:12:03,009 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-13 23:12:03,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-13 23:12:03,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-13 23:12:03,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-13 23:12:03,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-13 23:12:03,087 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 706) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1061173592) connection to jenkins-hbase4.apache.org/172.31.14.131:39105 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:44928 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1061173592) connection to jenkins-hbase4.apache.org/172.31.14.131:35167 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-1317 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_999195047_1 at /127.0.0.1:44894 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:50658 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:34220 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=445 (was 196) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=4023 (was 5860) 2023-07-13 23:12:03,088 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-13 23:12:03,111 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=445, ProcessCount=181, AvailableMemoryMB=4022 2023-07-13 23:12:03,112 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-13 23:12:03,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 23:12:03,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:03,125 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:12:03,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-13 23:12:03,128 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:12:03,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 23:12:03,131 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8 2023-07-13 23:12:03,131 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:03,132 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8 empty. 2023-07-13 23:12:03,132 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a empty. 2023-07-13 23:12:03,132 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8 2023-07-13 23:12:03,132 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:03,132 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-13 23:12:03,151 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-13 23:12:03,153 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 73548ce1382d243878970029651e7ec8, NAME => 'testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:12:03,153 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 116830a95ec3657a91244aeb6abfaf4a, NAME => 'testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:12:03,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:03,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 73548ce1382d243878970029651e7ec8, disabling compactions & flushes 2023-07-13 23:12:03,208 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:03,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:03,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. after waiting 0 ms 2023-07-13 23:12:03,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:03,208 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:03,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 73548ce1382d243878970029651e7ec8: 2023-07-13 23:12:03,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 23:12:03,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 23:12:03,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:03,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 116830a95ec3657a91244aeb6abfaf4a, disabling compactions & flushes 2023-07-13 23:12:03,608 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:03,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:03,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. after waiting 0 ms 2023-07-13 23:12:03,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:03,608 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:03,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 116830a95ec3657a91244aeb6abfaf4a: 2023-07-13 23:12:03,611 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:12:03,612 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289923612"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289923612"}]},"ts":"1689289923612"} 2023-07-13 23:12:03,612 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289923612"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289923612"}]},"ts":"1689289923612"} 2023-07-13 23:12:03,615 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:12:03,616 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:12:03,616 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289923616"}]},"ts":"1689289923616"} 2023-07-13 23:12:03,618 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-13 23:12:03,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:12:03,623 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:12:03,623 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:12:03,623 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:12:03,623 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:12:03,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73548ce1382d243878970029651e7ec8, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=116830a95ec3657a91244aeb6abfaf4a, ASSIGN}] 2023-07-13 23:12:03,630 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=116830a95ec3657a91244aeb6abfaf4a, ASSIGN 2023-07-13 23:12:03,630 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73548ce1382d243878970029651e7ec8, ASSIGN 2023-07-13 23:12:03,632 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=116830a95ec3657a91244aeb6abfaf4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43615,1689289892304; forceNewPlan=false, retain=false 2023-07-13 23:12:03,632 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73548ce1382d243878970029651e7ec8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37295,1689289892196; forceNewPlan=false, retain=false 2023-07-13 23:12:03,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 23:12:03,782 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:12:03,785 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=116830a95ec3657a91244aeb6abfaf4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:03,785 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=73548ce1382d243878970029651e7ec8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:03,785 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289923784"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289923784"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289923784"}]},"ts":"1689289923784"} 2023-07-13 23:12:03,785 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289923784"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289923784"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289923784"}]},"ts":"1689289923784"} 2023-07-13 23:12:03,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 116830a95ec3657a91244aeb6abfaf4a, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:12:03,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 73548ce1382d243878970029651e7ec8, server=jenkins-hbase4.apache.org,37295,1689289892196}] 2023-07-13 23:12:03,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:03,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 116830a95ec3657a91244aeb6abfaf4a, NAME => 'testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:12:03,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:03,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. service=AccessControlService 2023-07-13 23:12:03,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 73548ce1382d243878970029651e7ec8, NAME => 'testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:12:03,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:03,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:03,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:03,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:03,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:03,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. service=AccessControlService 2023-07-13 23:12:03,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:03,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 73548ce1382d243878970029651e7ec8 2023-07-13 23:12:03,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:03,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 73548ce1382d243878970029651e7ec8 2023-07-13 23:12:03,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 73548ce1382d243878970029651e7ec8 2023-07-13 23:12:03,946 INFO [StoreOpener-116830a95ec3657a91244aeb6abfaf4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:03,947 INFO [StoreOpener-73548ce1382d243878970029651e7ec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 73548ce1382d243878970029651e7ec8 2023-07-13 23:12:03,948 DEBUG [StoreOpener-116830a95ec3657a91244aeb6abfaf4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/cf 2023-07-13 23:12:03,948 DEBUG [StoreOpener-116830a95ec3657a91244aeb6abfaf4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/cf 2023-07-13 23:12:03,948 INFO [StoreOpener-116830a95ec3657a91244aeb6abfaf4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 116830a95ec3657a91244aeb6abfaf4a columnFamilyName cf 2023-07-13 23:12:03,949 DEBUG [StoreOpener-73548ce1382d243878970029651e7ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/cf 2023-07-13 23:12:03,949 DEBUG [StoreOpener-73548ce1382d243878970029651e7ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/cf 2023-07-13 23:12:03,950 INFO [StoreOpener-73548ce1382d243878970029651e7ec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73548ce1382d243878970029651e7ec8 columnFamilyName cf 2023-07-13 23:12:03,950 INFO [StoreOpener-116830a95ec3657a91244aeb6abfaf4a-1] regionserver.HStore(310): Store=116830a95ec3657a91244aeb6abfaf4a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:03,954 INFO [StoreOpener-73548ce1382d243878970029651e7ec8-1] regionserver.HStore(310): Store=73548ce1382d243878970029651e7ec8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:03,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:03,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8 2023-07-13 23:12:03,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:03,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8 2023-07-13 23:12:03,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:03,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 73548ce1382d243878970029651e7ec8 2023-07-13 23:12:03,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:03,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 116830a95ec3657a91244aeb6abfaf4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59397807, jitterRate=-0.11490370333194733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:03,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 116830a95ec3657a91244aeb6abfaf4a: 2023-07-13 23:12:03,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:03,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 73548ce1382d243878970029651e7ec8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59586859, jitterRate=-0.11208660900592804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:03,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 73548ce1382d243878970029651e7ec8: 2023-07-13 23:12:03,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a., pid=30, masterSystemTime=1689289923940 2023-07-13 23:12:03,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8., pid=31, masterSystemTime=1689289923941 2023-07-13 23:12:03,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:03,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:03,971 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=116830a95ec3657a91244aeb6abfaf4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:03,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:03,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:03,971 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289923970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289923970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289923970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289923970"}]},"ts":"1689289923970"} 2023-07-13 23:12:03,972 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=73548ce1382d243878970029651e7ec8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:03,972 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289923972"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289923972"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289923972"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289923972"}]},"ts":"1689289923972"} 2023-07-13 23:12:03,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-13 23:12:03,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 116830a95ec3657a91244aeb6abfaf4a, server=jenkins-hbase4.apache.org,43615,1689289892304 in 187 msec 2023-07-13 23:12:03,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-13 23:12:03,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 73548ce1382d243878970029651e7ec8, server=jenkins-hbase4.apache.org,37295,1689289892196 in 188 msec 2023-07-13 23:12:03,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=116830a95ec3657a91244aeb6abfaf4a, ASSIGN in 357 msec 2023-07-13 23:12:03,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-13 23:12:03,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73548ce1382d243878970029651e7ec8, ASSIGN in 359 msec 2023-07-13 23:12:03,987 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:12:03,987 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289923987"}]},"ts":"1689289923987"} 2023-07-13 23:12:03,992 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-13 23:12:03,999 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:12:03,999 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-13 23:12:04,002 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:12:04,003 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:04,003 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:04,003 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:04,003 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:04,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:04,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:04,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:04,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:04,008 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 885 msec 2023-07-13 23:12:04,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 23:12:04,235 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-13 23:12:04,238 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-13 23:12:04,238 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:04,240 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:04,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:04,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289924255 (current time:1689289924255). 2023-07-13 23:12:04,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:04,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x0bd58d77 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:04,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37a28f06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:04,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:04,264 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:04,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bd58d77 to 127.0.0.1:63739 2023-07-13 23:12:04,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:04,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x59b891e7 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:04,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ea11192, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:04,273 DEBUG [hconnection-0x5d586bff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:04,276 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:04,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:04,281 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:04,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59b891e7 to 127.0.0.1:63739 2023-07-13 23:12:04,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:04,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:12:04,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:04,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:04,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:04,287 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:04,288 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689290524288 2023-07-13 23:12:04,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:04,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-13 23:12:04,290 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:04,290 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:04,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:04,291 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:04,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-13 23:12:04,294 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:04,295 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689290524295 2023-07-13 23:12:04,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,309 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-13 23:12:04,309 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:04,310 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-13 23:12:04,311 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-13 23:12:04,311 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,311 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,313 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,313 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,313 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,313 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,313 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,313 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,314 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,314 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:04,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:04,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,315 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:04,315 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:04,315 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:04,315 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:04,316 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:04,317 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:04,315 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:04,317 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:04,319 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:04,319 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:04,319 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:04,324 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,324 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,324 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,324 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-13 23:12:04,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1452c6c7[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-13 23:12:04,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1452c6c7[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:04,330 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 23:12:04,330 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,331 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,331 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,331 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,332 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:04,332 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,332 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:04,332 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:04,332 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:04,332 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,332 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:04,332 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:12:04,334 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:04,335 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:04,335 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:04,335 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:04,335 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. started... 2023-07-13 23:12:04,335 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:04,335 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:04,335 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. started... 2023-07-13 23:12:04,336 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 116830a95ec3657a91244aeb6abfaf4a: 2023-07-13 23:12:04,336 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73548ce1382d243878970029651e7ec8: 2023-07-13 23:12:04,337 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:04,337 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:04,337 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,337 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:04,338 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,338 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:04,338 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:04,338 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:04,338 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:04,356 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. completed. 2023-07-13 23:12:04,356 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:04,356 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:04,356 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:04,357 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,357 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:04,357 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:12:04,358 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. completed. 2023-07-13 23:12:04,358 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:04,358 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:04,358 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:04,358 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,358 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:04,359 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:12:04,359 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:04,359 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,359 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,359 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:04,361 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,361 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:04,361 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:04,361 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:12:04,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 23:12:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37295,1689289892196': 2023-07-13 23:12:04,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 23:12:04,373 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-13 23:12:04,373 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:04,373 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:04,373 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,373 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:04,375 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,375 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,375 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,375 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,375 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,375 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,376 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,377 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,377 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,378 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,381 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,382 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,383 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,387 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,387 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,387 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,387 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,387 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,387 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,388 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,387 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-13 23:12:04,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:12:04,387 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:04,387 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 23:12:04,390 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,388 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,392 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,392 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,392 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,392 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,392 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,392 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,392 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:12:04,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:04,393 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:04,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-13 23:12:04,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,467 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:04,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689289924288Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689289924406 (+118 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689289924406Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689289924406Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689289924417 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689289924430 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689289924466 (+36 ms) 2023-07-13 23:12:04,470 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:04,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 181 msec 2023-07-13 23:12:04,593 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:04,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:12:04,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:04,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37295] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:04,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:04,608 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-13 23:12:04,608 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:04,608 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:04,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:04,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289924621 (current time:1689289924621). 2023-07-13 23:12:04,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:04,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x01e720c7 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:04,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9d56c31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:04,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:04,633 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:04,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01e720c7 to 127.0.0.1:63739 2023-07-13 23:12:04,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:04,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x22ac2f35 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:04,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38638124, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:04,643 DEBUG [hconnection-0x63916a8b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:04,644 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:04,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:04,651 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:04,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22ac2f35 to 127.0.0.1:63739 2023-07-13 23:12:04,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:04,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:12:04,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:04,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:04,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:04,658 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:04,659 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689290524659 2023-07-13 23:12:04,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:04,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-13 23:12:04,661 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:04,661 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:04,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:04,663 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:04,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-13 23:12:04,666 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:04,667 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689290524667 2023-07-13 23:12:04,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-13 23:12:04,687 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-13 23:12:04,687 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:04,689 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-13 23:12:04,689 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-13 23:12:04,690 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,690 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,691 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,691 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,691 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,691 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,692 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,693 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 23:12:04,693 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,693 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,693 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:04,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:04,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 23:12:04,694 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:04,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 23:12:04,694 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:04,694 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:04,694 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:04,698 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:04,698 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:04,698 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:04,698 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:04,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 23:12:04,698 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:04,698 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:04,698 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:04,698 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:04,700 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:04,700 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:04,700 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:04,701 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,702 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,702 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,703 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,703 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,704 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,703 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,704 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:04,704 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:04,704 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,704 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-13 23:12:04,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68ddfe83[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-13 23:12:04,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68ddfe83[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:04,708 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 23:12:04,708 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,709 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,709 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,709 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,709 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,710 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:04,710 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:04,710 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:04,710 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:12:04,710 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,710 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:04,710 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:04,710 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:04,710 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:04,710 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. started... 2023-07-13 23:12:04,710 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:04,710 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:04,710 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:04,710 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:04,710 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 73548ce1382d243878970029651e7ec8 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-13 23:12:04,711 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. started... 2023-07-13 23:12:04,711 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 116830a95ec3657a91244aeb6abfaf4a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-13 23:12:04,712 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:04,712 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:04,712 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:04,751 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071313277cbc6c154fa98e7e8ca01741d661 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071313277cbc6c154fa98e7e8ca01741d661 2023-07-13 23:12:04,757 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230713db530e4ab3de41df979561503671f405 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713db530e4ab3de41df979561503671f405 2023-07-13 23:12:04,762 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:04,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:12:04,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:04,763 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:04,779 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/.tmp/cf/5da1dab48110491abd0c80ace5d06376 2023-07-13 23:12:04,786 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/.tmp/cf/5da1dab48110491abd0c80ace5d06376 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/cf/5da1dab48110491abd0c80ace5d06376 2023-07-13 23:12:04,787 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/.tmp/cf/27fc5d977ff14b188de1fa3c8f9efff4 2023-07-13 23:12:04,793 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/cf/5da1dab48110491abd0c80ace5d06376, entries=46, sequenceid=6, filesize=12.7 K 2023-07-13 23:12:04,795 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 116830a95ec3657a91244aeb6abfaf4a in 84ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:04,795 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-13 23:12:04,795 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/.tmp/cf/27fc5d977ff14b188de1fa3c8f9efff4 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/cf/27fc5d977ff14b188de1fa3c8f9efff4 2023-07-13 23:12:04,796 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 116830a95ec3657a91244aeb6abfaf4a: 2023-07-13 23:12:04,796 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 23:12:04,796 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:04,796 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/cf/5da1dab48110491abd0c80ace5d06376] hfiles 2023-07-13 23:12:04,796 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/cf/5da1dab48110491abd0c80ace5d06376 for snapshot=snaptb0-testExportFileSystemState 2023-07-13 23:12:04,801 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/cf/27fc5d977ff14b188de1fa3c8f9efff4, entries=4, sequenceid=6, filesize=5.6 K 2023-07-13 23:12:04,802 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 73548ce1382d243878970029651e7ec8 in 92ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:04,806 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73548ce1382d243878970029651e7ec8: 2023-07-13 23:12:04,806 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 23:12:04,806 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:04,806 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/cf/27fc5d977ff14b188de1fa3c8f9efff4] hfiles 2023-07-13 23:12:04,806 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/cf/27fc5d977ff14b188de1fa3c8f9efff4 for snapshot=snaptb0-testExportFileSystemState 2023-07-13 23:12:04,814 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. completed. 2023-07-13 23:12:04,814 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:04,814 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:04,814 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:04,814 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,814 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:04,814 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:12:04,821 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,821 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,822 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:04,822 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,824 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. completed. 2023-07-13 23:12:04,824 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:04,824 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:04,824 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,824 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,825 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:04,825 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:12:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,826 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:04,826 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:04,827 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:04,826 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:04,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:12:04,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 23:12:04,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:04,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37295,1689289892196': 2023-07-13 23:12:04,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 23:12:04,837 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-13 23:12:04,837 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:04,837 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:04,837 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-13 23:12:04,837 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:04,839 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,839 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,839 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,839 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,839 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,841 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:04,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:04,841 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,842 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,843 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:04,844 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:04,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:04,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,846 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:04,847 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:04,847 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,850 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,850 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,851 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,850 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,850 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,851 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,851 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,850 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:04,851 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:04,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-13 23:12:04,851 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-13 23:12:04,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,851 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:04,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:04,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:04,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 23:12:04,851 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:12:04,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,852 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:04,852 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,852 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:04,852 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:04,852 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,852 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:04,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713db530e4ab3de41df979561503671f405, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071313277cbc6c154fa98e7e8ca01741d661] mob files 2023-07-13 23:12:04,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713db530e4ab3de41df979561503671f405 2023-07-13 23:12:04,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071313277cbc6c154fa98e7e8ca01741d661 2023-07-13 23:12:04,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-13 23:12:04,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-13 23:12:04,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,952 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689289924660Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689289924868 (+208 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689289924868Loading Region manifests for snaptb0-testExportFileSystemState at 1689289924868Writing data manifest for snaptb0-testExportFileSystemState at 1689289924872 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689289924883 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689289924951 (+68 ms) 2023-07-13 23:12:04,955 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:04,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 295 msec 2023-07-13 23:12:04,963 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:04,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:12:04,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:04,965 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965 2023-07-13 23:12:04,965 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33689, tgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965, rawTgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965, srcFsUri=hdfs://localhost:33689, srcDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:12:04,990 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:12:04,990 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1627782657_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:04,990 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29, snapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-13 23:12:05,015 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:05,044 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:05,045 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:05,045 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:05,046 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:06,039 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-568013052203051405.jar 2023-07-13 23:12:06,040 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:06,040 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:06,108 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-7111546272825021645.jar 2023-07-13 23:12:06,108 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:06,109 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:06,109 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:06,110 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:06,110 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:06,110 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:06,111 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:12:06,111 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:12:06,112 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:12:06,112 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:12:06,112 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:12:06,113 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:12:06,113 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:12:06,114 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:12:06,114 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:12:06,115 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:12:06,115 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:06,117 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:06,117 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:06,118 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:06,625 WARN [Listener at jenkins-hbase4.apache.org/35127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:12:06,628 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-13 23:12:06,631 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-13 23:12:06,777 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:06,778 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:06,786 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0001_000001 (auth:SIMPLE) 2023-07-13 23:12:06,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:08,409 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:12:11,943 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:14,187 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:17,723 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:18,904 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:12:18,909 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:12:18,956 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-13 23:12:18,956 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:12:18,957 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:12:18,957 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 23:12:18,958 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-13 23:12:18,958 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-13 23:12:18,958 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 23:12:18,959 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-13 23:12:18,959 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289924965/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-13 23:12:18,970 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-13 23:12:18,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-13 23:12:18,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:18,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 23:12:18,976 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289938976"}]},"ts":"1689289938976"} 2023-07-13 23:12:18,977 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-13 23:12:18,980 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-13 23:12:18,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73548ce1382d243878970029651e7ec8, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=116830a95ec3657a91244aeb6abfaf4a, UNASSIGN}] 2023-07-13 23:12:18,984 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73548ce1382d243878970029651e7ec8, UNASSIGN 2023-07-13 23:12:18,984 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=116830a95ec3657a91244aeb6abfaf4a, UNASSIGN 2023-07-13 23:12:18,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=73548ce1382d243878970029651e7ec8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:18,984 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=116830a95ec3657a91244aeb6abfaf4a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:18,985 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289938984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289938984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289938984"}]},"ts":"1689289938984"} 2023-07-13 23:12:18,985 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289938984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289938984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289938984"}]},"ts":"1689289938984"} 2023-07-13 23:12:18,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 73548ce1382d243878970029651e7ec8, server=jenkins-hbase4.apache.org,37295,1689289892196}] 2023-07-13 23:12:18,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 116830a95ec3657a91244aeb6abfaf4a, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:12:19,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 23:12:19,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 73548ce1382d243878970029651e7ec8 2023-07-13 23:12:19,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 73548ce1382d243878970029651e7ec8, disabling compactions & flushes 2023-07-13 23:12:19,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:19,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:19,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. after waiting 0 ms 2023-07-13 23:12:19,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:19,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:19,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 116830a95ec3657a91244aeb6abfaf4a, disabling compactions & flushes 2023-07-13 23:12:19,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:19,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:19,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. after waiting 0 ms 2023-07-13 23:12:19,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:19,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:19,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:19,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8. 2023-07-13 23:12:19,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 73548ce1382d243878970029651e7ec8: 2023-07-13 23:12:19,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:19,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:19,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a. 2023-07-13 23:12:19,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 116830a95ec3657a91244aeb6abfaf4a: 2023-07-13 23:12:19,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:19,178 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=116830a95ec3657a91244aeb6abfaf4a, regionState=CLOSED 2023-07-13 23:12:19,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 73548ce1382d243878970029651e7ec8 2023-07-13 23:12:19,178 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289939178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289939178"}]},"ts":"1689289939178"} 2023-07-13 23:12:19,179 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=73548ce1382d243878970029651e7ec8, regionState=CLOSED 2023-07-13 23:12:19,179 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289939179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289939179"}]},"ts":"1689289939179"} 2023-07-13 23:12:19,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-13 23:12:19,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-13 23:12:19,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 116830a95ec3657a91244aeb6abfaf4a, server=jenkins-hbase4.apache.org,43615,1689289892304 in 193 msec 2023-07-13 23:12:19,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 73548ce1382d243878970029651e7ec8, server=jenkins-hbase4.apache.org,37295,1689289892196 in 195 msec 2023-07-13 23:12:19,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73548ce1382d243878970029651e7ec8, UNASSIGN in 206 msec 2023-07-13 23:12:19,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-13 23:12:19,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=116830a95ec3657a91244aeb6abfaf4a, UNASSIGN in 206 msec 2023-07-13 23:12:19,191 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289939191"}]},"ts":"1689289939191"} 2023-07-13 23:12:19,192 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-13 23:12:19,194 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-13 23:12:19,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 225 msec 2023-07-13 23:12:19,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 23:12:19,278 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-13 23:12:19,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-13 23:12:19,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:19,284 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:19,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-13 23:12:19,285 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:19,286 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-13 23:12:19,289 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:19,289 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:19,289 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:19,289 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:19,290 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 23:12:19,290 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 23:12:19,290 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 23:12:19,290 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 23:12:19,290 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8 2023-07-13 23:12:19,290 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:19,292 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:19,292 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:19,292 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:19,293 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:19,292 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:19,293 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:19,292 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:19,292 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:19,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-13 23:12:19,294 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/recovered.edits] 2023-07-13 23:12:19,294 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/recovered.edits] 2023-07-13 23:12:19,299 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/cf/5da1dab48110491abd0c80ace5d06376 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/cf/5da1dab48110491abd0c80ace5d06376 2023-07-13 23:12:19,300 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/cf/27fc5d977ff14b188de1fa3c8f9efff4 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/cf/27fc5d977ff14b188de1fa3c8f9efff4 2023-07-13 23:12:19,303 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a/recovered.edits/9.seqid 2023-07-13 23:12:19,304 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/116830a95ec3657a91244aeb6abfaf4a 2023-07-13 23:12:19,304 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8/recovered.edits/9.seqid 2023-07-13 23:12:19,305 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemState/73548ce1382d243878970029651e7ec8 2023-07-13 23:12:19,305 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-13 23:12:19,305 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-13 23:12:19,306 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-13 23:12:19,310 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713db530e4ab3de41df979561503671f405 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713db530e4ab3de41df979561503671f405 2023-07-13 23:12:19,311 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071313277cbc6c154fa98e7e8ca01741d661 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071313277cbc6c154fa98e7e8ca01741d661 2023-07-13 23:12:19,312 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-13 23:12:19,315 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:19,318 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-13 23:12:19,321 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-13 23:12:19,323 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:19,323 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-13 23:12:19,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289939323"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:19,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289939323"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:19,327 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:12:19,327 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 73548ce1382d243878970029651e7ec8, NAME => 'testtb-testExportFileSystemState,,1689289923119.73548ce1382d243878970029651e7ec8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 116830a95ec3657a91244aeb6abfaf4a, NAME => 'testtb-testExportFileSystemState,1,1689289923119.116830a95ec3657a91244aeb6abfaf4a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:12:19,328 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-13 23:12:19,328 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289939328"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:19,330 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-13 23:12:19,332 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:19,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 53 msec 2023-07-13 23:12:19,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-13 23:12:19,396 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-13 23:12:19,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-13 23:12:19,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:19,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-13 23:12:19,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-13 23:12:19,435 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=759 (was 751) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-550851129_1 at /127.0.0.1:49594 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:37700 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1061173592) connection to jenkins-hbase4.apache.org/172.31.14.131:45411 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:56482 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:49618 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2026 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1061173592) connection to jenkins-hbase4.apache.org/172.31.14.131:38275 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=931 (was 919) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=389 (was 445), ProcessCount=181 (was 181), AvailableMemoryMB=3795 (was 4022) 2023-07-13 23:12:19,435 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-13 23:12:19,455 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=759, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=389, ProcessCount=181, AvailableMemoryMB=3795 2023-07-13 23:12:19,455 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-13 23:12:19,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 23:12:19,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:19,461 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:12:19,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-13 23:12:19,462 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:12:19,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 23:12:19,464 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49 2023-07-13 23:12:19,465 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:19,465 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49 empty. 2023-07-13 23:12:19,465 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818 empty. 2023-07-13 23:12:19,466 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49 2023-07-13 23:12:19,466 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:19,466 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-13 23:12:19,478 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-13 23:12:19,480 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7e699ec2a4883744104938700238cf49, NAME => 'testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:12:19,480 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 65c35500d5fbd40312493c1c86f09818, NAME => 'testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:12:19,495 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:19,495 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 65c35500d5fbd40312493c1c86f09818, disabling compactions & flushes 2023-07-13 23:12:19,495 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:19,495 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:19,495 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. after waiting 0 ms 2023-07-13 23:12:19,495 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:19,495 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:19,495 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 65c35500d5fbd40312493c1c86f09818: 2023-07-13 23:12:19,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:19,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7e699ec2a4883744104938700238cf49, disabling compactions & flushes 2023-07-13 23:12:19,503 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:19,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:19,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. after waiting 0 ms 2023-07-13 23:12:19,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:19,503 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:19,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7e699ec2a4883744104938700238cf49: 2023-07-13 23:12:19,506 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:12:19,507 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289939507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289939507"}]},"ts":"1689289939507"} 2023-07-13 23:12:19,507 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289939507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289939507"}]},"ts":"1689289939507"} 2023-07-13 23:12:19,509 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:12:19,510 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:12:19,510 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289939510"}]},"ts":"1689289939510"} 2023-07-13 23:12:19,512 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-13 23:12:19,515 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:12:19,516 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:12:19,516 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:12:19,516 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:12:19,516 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:12:19,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e699ec2a4883744104938700238cf49, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65c35500d5fbd40312493c1c86f09818, ASSIGN}] 2023-07-13 23:12:19,519 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65c35500d5fbd40312493c1c86f09818, ASSIGN 2023-07-13 23:12:19,519 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e699ec2a4883744104938700238cf49, ASSIGN 2023-07-13 23:12:19,519 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65c35500d5fbd40312493c1c86f09818, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43615,1689289892304; forceNewPlan=false, retain=false 2023-07-13 23:12:19,520 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e699ec2a4883744104938700238cf49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34053,1689289892354; forceNewPlan=false, retain=false 2023-07-13 23:12:19,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 23:12:19,670 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:12:19,673 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=65c35500d5fbd40312493c1c86f09818, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:19,673 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7e699ec2a4883744104938700238cf49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:19,673 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289939673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289939673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289939673"}]},"ts":"1689289939673"} 2023-07-13 23:12:19,673 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289939673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289939673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289939673"}]},"ts":"1689289939673"} 2023-07-13 23:12:19,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 7e699ec2a4883744104938700238cf49, server=jenkins-hbase4.apache.org,34053,1689289892354}] 2023-07-13 23:12:19,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 65c35500d5fbd40312493c1c86f09818, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:12:19,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 23:12:19,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:19,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 65c35500d5fbd40312493c1c86f09818, NAME => 'testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:12:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. service=AccessControlService 2023-07-13 23:12:19,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:19,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:19,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:19,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7e699ec2a4883744104938700238cf49, NAME => 'testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:12:19,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. service=AccessControlService 2023-07-13 23:12:19,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:19,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7e699ec2a4883744104938700238cf49 2023-07-13 23:12:19,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:19,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7e699ec2a4883744104938700238cf49 2023-07-13 23:12:19,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7e699ec2a4883744104938700238cf49 2023-07-13 23:12:19,838 INFO [StoreOpener-65c35500d5fbd40312493c1c86f09818-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:19,839 INFO [StoreOpener-7e699ec2a4883744104938700238cf49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7e699ec2a4883744104938700238cf49 2023-07-13 23:12:19,840 DEBUG [StoreOpener-65c35500d5fbd40312493c1c86f09818-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/cf 2023-07-13 23:12:19,840 DEBUG [StoreOpener-65c35500d5fbd40312493c1c86f09818-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/cf 2023-07-13 23:12:19,841 INFO [StoreOpener-65c35500d5fbd40312493c1c86f09818-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65c35500d5fbd40312493c1c86f09818 columnFamilyName cf 2023-07-13 23:12:19,841 DEBUG [StoreOpener-7e699ec2a4883744104938700238cf49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/cf 2023-07-13 23:12:19,841 DEBUG [StoreOpener-7e699ec2a4883744104938700238cf49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/cf 2023-07-13 23:12:19,841 INFO [StoreOpener-7e699ec2a4883744104938700238cf49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e699ec2a4883744104938700238cf49 columnFamilyName cf 2023-07-13 23:12:19,842 INFO [StoreOpener-65c35500d5fbd40312493c1c86f09818-1] regionserver.HStore(310): Store=65c35500d5fbd40312493c1c86f09818/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:19,842 INFO [StoreOpener-7e699ec2a4883744104938700238cf49-1] regionserver.HStore(310): Store=7e699ec2a4883744104938700238cf49/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:19,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:19,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49 2023-07-13 23:12:19,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:19,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49 2023-07-13 23:12:19,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:19,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7e699ec2a4883744104938700238cf49 2023-07-13 23:12:19,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:19,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 65c35500d5fbd40312493c1c86f09818; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64572924, jitterRate=-0.037788450717926025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:19,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 65c35500d5fbd40312493c1c86f09818: 2023-07-13 23:12:19,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818., pid=46, masterSystemTime=1689289939828 2023-07-13 23:12:19,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:19,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:19,853 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=65c35500d5fbd40312493c1c86f09818, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:19,853 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289939853"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289939853"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289939853"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289939853"}]},"ts":"1689289939853"} 2023-07-13 23:12:19,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-13 23:12:19,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 65c35500d5fbd40312493c1c86f09818, server=jenkins-hbase4.apache.org,43615,1689289892304 in 179 msec 2023-07-13 23:12:19,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65c35500d5fbd40312493c1c86f09818, ASSIGN in 342 msec 2023-07-13 23:12:19,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:19,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7e699ec2a4883744104938700238cf49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67846400, jitterRate=0.010990142822265625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:19,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7e699ec2a4883744104938700238cf49: 2023-07-13 23:12:19,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49., pid=45, masterSystemTime=1689289939828 2023-07-13 23:12:19,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:19,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:19,867 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7e699ec2a4883744104938700238cf49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:19,867 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289939867"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289939867"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289939867"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289939867"}]},"ts":"1689289939867"} 2023-07-13 23:12:19,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-13 23:12:19,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 7e699ec2a4883744104938700238cf49, server=jenkins-hbase4.apache.org,34053,1689289892354 in 194 msec 2023-07-13 23:12:19,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-13 23:12:19,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e699ec2a4883744104938700238cf49, ASSIGN in 358 msec 2023-07-13 23:12:19,882 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:12:19,882 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289939882"}]},"ts":"1689289939882"} 2023-07-13 23:12:19,883 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-13 23:12:19,886 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:12:19,886 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-13 23:12:19,888 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 23:12:19,891 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:19,891 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:19,891 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:19,891 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:19,893 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:19,893 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:19,894 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:19,894 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:19,894 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:19,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 437 msec 2023-07-13 23:12:20,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 23:12:20,066 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-13 23:12:20,068 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-13 23:12:20,068 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:20,071 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:20,078 DEBUG [hconnection-0x4b6a6c9c-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:20,083 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:20,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:20,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289940087 (current time:1689289940087). 2023-07-13 23:12:20,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:20,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x4297d36b to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:20,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c61fb1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:20,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:20,096 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:20,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4297d36b to 127.0.0.1:63739 2023-07-13 23:12:20,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:20,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x2db06f5b to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:20,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b2fcb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:20,104 DEBUG [hconnection-0x26e1ca16-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:20,107 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:20,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:20,113 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:20,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2db06f5b to 127.0.0.1:63739 2023-07-13 23:12:20,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:20,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 23:12:20,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:20,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:20,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:20,118 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:20,119 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689290540119 2023-07-13 23:12:20,119 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-13 23:12:20,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:20,120 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:20,120 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:20,124 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:20,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:20,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-13 23:12:20,126 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:20,127 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689290540126 2023-07-13 23:12:20,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,144 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-13 23:12:20,144 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:20,146 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-13 23:12:20,146 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-13 23:12:20,147 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,147 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,148 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,148 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,148 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,148 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,149 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,149 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,149 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,149 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:20,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 23:12:20,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,151 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:20,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,151 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:20,151 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:20,153 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:20,153 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:20,154 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:20,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 23:12:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,155 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 23:12:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:20,157 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,158 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:20,158 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:20,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,164 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:20,164 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:20,164 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:20,164 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:20,164 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:20,169 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:20,169 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:20,169 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:20,169 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,169 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:20,170 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,171 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,172 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,172 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,172 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,172 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:20,173 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,173 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:20,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-13 23:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d95f8b6[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-13 23:12:20,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d95f8b6[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:20,180 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-13 23:12:20,180 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:20,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:20,182 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:20,182 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:20,183 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. started... 2023-07-13 23:12:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:12:20,183 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,184 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. started... 2023-07-13 23:12:20,185 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 65c35500d5fbd40312493c1c86f09818: 2023-07-13 23:12:20,185 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7e699ec2a4883744104938700238cf49: 2023-07-13 23:12:20,185 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,185 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,186 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,186 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:20,186 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:20,186 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:20,186 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:20,186 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:20,189 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:20,189 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:20,189 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:20,208 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. completed. 2023-07-13 23:12:20,208 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:20,208 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:20,208 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:20,208 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,208 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:20,208 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:12:20,209 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. completed. 2023-07-13 23:12:20,209 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:12:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:20,213 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:20,215 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:12:20,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-13 23:12:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,221 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 23:12:20,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:20,222 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34053,1689289892354': 2023-07-13 23:12:20,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-13 23:12:20,224 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-13 23:12:20,224 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:20,224 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:20,224 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,224 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:20,226 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,226 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,226 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,227 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,227 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,229 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,229 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,230 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,232 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,233 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,233 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-13 23:12:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,233 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,233 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:12:20,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,235 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 23:12:20,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-13 23:12:20,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,294 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:20,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689289940119Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689289940249 (+130 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689289940249Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689289940249Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689289940254 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689289940263 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689289940294 (+31 ms) 2023-07-13 23:12:20,297 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:20,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 177 msec 2023-07-13 23:12:20,422 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:20,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 23:12:20,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:20,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34053] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:20,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43615] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:20,432 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-13 23:12:20,432 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:20,432 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:20,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:20,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289940444 (current time:1689289940444). 2023-07-13 23:12:20,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:20,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x2fdf4882 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:20,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b4b3c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:20,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:20,462 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:20,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fdf4882 to 127.0.0.1:63739 2023-07-13 23:12:20,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:20,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x02515ead to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:20,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@579f8d3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:20,470 DEBUG [hconnection-0x16f40ebd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:20,473 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:20,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:20,477 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:20,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02515ead to 127.0.0.1:63739 2023-07-13 23:12:20,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:20,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 23:12:20,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:20,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:20,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:20,483 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:20,484 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689290540484 2023-07-13 23:12:20,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:20,485 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-13 23:12:20,486 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:20,486 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:20,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:20,488 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:20,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-13 23:12:20,490 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:20,491 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689290540491 2023-07-13 23:12:20,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-13 23:12:20,508 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-13 23:12:20,508 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:20,510 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-13 23:12:20,510 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-13 23:12:20,510 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,510 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,513 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,513 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,513 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,513 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,513 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,513 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,514 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,514 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:20,515 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:20,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 23:12:20,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 23:12:20,515 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:20,515 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:20,515 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:20,515 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:20,516 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:20,517 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:20,516 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 23:12:20,517 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:20,518 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:20,518 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:20,517 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:20,519 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:20,519 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:20,519 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:20,518 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:20,519 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:20,520 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,521 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,521 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,522 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:20,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-13 23:12:20,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c2a1a52[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:20,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-13 23:12:20,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c2a1a52[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:20,526 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-13 23:12:20,526 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:20,528 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:12:20,528 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,528 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:20,528 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:20,528 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:20,529 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. started... 2023-07-13 23:12:20,529 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7e699ec2a4883744104938700238cf49 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-13 23:12:20,529 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. started... 2023-07-13 23:12:20,529 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 65c35500d5fbd40312493c1c86f09818 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-13 23:12:20,532 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:20,532 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:20,532 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:20,555 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230713522671fc5c1e4ae28fd6e59bac6821d6 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713522671fc5c1e4ae28fd6e59bac6821d6 2023-07-13 23:12:20,558 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230713065bf04cdf81486ab1ec3d7a79e1ed1a to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230713065bf04cdf81486ab1ec3d7a79e1ed1a 2023-07-13 23:12:20,564 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/.tmp/cf/8651e3b240a9475393cfcc02252b3c31 2023-07-13 23:12:20,568 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/.tmp/cf/3bd6578ad6fe4790a3c25a4280709f11 2023-07-13 23:12:20,570 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/.tmp/cf/8651e3b240a9475393cfcc02252b3c31 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/cf/8651e3b240a9475393cfcc02252b3c31 2023-07-13 23:12:20,577 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/.tmp/cf/3bd6578ad6fe4790a3c25a4280709f11 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/cf/3bd6578ad6fe4790a3c25a4280709f11 2023-07-13 23:12:20,579 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/cf/8651e3b240a9475393cfcc02252b3c31, entries=5, sequenceid=6, filesize=5.7 K 2023-07-13 23:12:20,580 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 7e699ec2a4883744104938700238cf49 in 51ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:20,580 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-13 23:12:20,581 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7e699ec2a4883744104938700238cf49: 2023-07-13 23:12:20,581 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 23:12:20,581 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:20,582 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/cf/8651e3b240a9475393cfcc02252b3c31] hfiles 2023-07-13 23:12:20,582 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/cf/8651e3b240a9475393cfcc02252b3c31 for snapshot=snaptb0-testConsecutiveExports 2023-07-13 23:12:20,583 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/cf/3bd6578ad6fe4790a3c25a4280709f11, entries=45, sequenceid=6, filesize=12.4 K 2023-07-13 23:12:20,586 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:20,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 23:12:20,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:20,588 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:20,590 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 65c35500d5fbd40312493c1c86f09818 in 61ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:20,591 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 65c35500d5fbd40312493c1c86f09818: 2023-07-13 23:12:20,591 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 23:12:20,591 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:20,591 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/cf/3bd6578ad6fe4790a3c25a4280709f11] hfiles 2023-07-13 23:12:20,591 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/cf/3bd6578ad6fe4790a3c25a4280709f11 for snapshot=snaptb0-testConsecutiveExports 2023-07-13 23:12:20,592 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. completed. 2023-07-13 23:12:20,592 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:20,592 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:20,592 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:20,592 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,592 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:20,592 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:12:20,594 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,594 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:20,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,594 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:20,594 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:20,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34053,1689289892354': 2023-07-13 23:12:20,600 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. completed. 2023-07-13 23:12:20,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-13 23:12:20,600 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:20,600 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:20,600 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:20,600 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,600 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:20,600 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:12:20,602 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:20,602 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,602 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:20,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,602 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:12:20,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-13 23:12:20,607 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-13 23:12:20,607 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:20,607 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:20,607 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-13 23:12:20,607 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:20,608 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,608 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,608 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,608 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,608 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,608 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:20,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,609 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,609 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:20,609 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:20,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,610 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:20,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,612 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,612 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,612 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,619 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,620 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,619 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-13 23:12:20,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,619 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,620 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,619 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,620 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,620 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-13 23:12:20,620 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,620 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:20,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 23:12:20,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,620 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:12:20,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:20,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:20,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:20,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230713065bf04cdf81486ab1ec3d7a79e1ed1a, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713522671fc5c1e4ae28fd6e59bac6821d6] mob files 2023-07-13 23:12:20,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230713065bf04cdf81486ab1ec3d7a79e1ed1a 2023-07-13 23:12:20,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713522671fc5c1e4ae28fd6e59bac6821d6 2023-07-13 23:12:20,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-13 23:12:20,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,694 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-13 23:12:20,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,694 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689289940485Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689289940630 (+145 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689289940630Loading Region manifests for snaptb0-testConsecutiveExports at 1689289940630Writing data manifest for snaptb0-testConsecutiveExports at 1689289940634 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689289940643 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689289940694 (+51 ms) 2023-07-13 23:12:20,697 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:20,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 212 msec 2023-07-13 23:12:20,788 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:20,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 23:12:20,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:20,790 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789 2023-07-13 23:12:20,790 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789, srcFsUri=hdfs://localhost:33689, srcDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:12:20,823 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:12:20,824 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3d8f08c8, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,824 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29, snapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-13 23:12:20,833 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,846 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:20,846 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:20,847 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:20,847 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,788 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-3790930618662274895.jar 2023-07-13 23:12:21,788 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,788 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,871 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-2182487502364225678.jar 2023-07-13 23:12:21,872 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,872 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,873 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,874 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,874 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,875 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,875 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:12:21,876 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:12:21,877 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:12:21,877 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:12:21,878 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:12:21,878 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:12:21,879 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:12:21,879 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:12:21,879 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:12:21,880 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:12:21,881 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:21,881 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:21,882 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:21,882 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:21,882 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:21,883 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:21,883 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:22,712 WARN [Listener at jenkins-hbase4.apache.org/35127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:12:22,714 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-13 23:12:22,716 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-13 23:12:23,915 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:23,915 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:23,918 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:24,711 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:24,762 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:12:29,037 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:31,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:33,935 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:35,882 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:12:35,883 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:12:35,887 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-13 23:12:35,887 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:12:35,888 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:12:35,888 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:35,890 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 23:12:35,890 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 23:12:35,890 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2c338a09 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:35,891 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 23:12:35,891 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 23:12:35,892 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789, srcFsUri=hdfs://localhost:33689, srcDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:12:35,913 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:12:35,914 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@43be9a30, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:35,914 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29, snapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-13 23:12:35,923 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:35,935 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,936 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,936 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,936 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:36,822 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-2744352071835390978.jar 2023-07-13 23:12:36,822 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:36,823 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:36,889 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-9190870738491114125.jar 2023-07-13 23:12:36,890 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:36,890 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:36,891 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:36,891 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:36,891 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:36,892 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:36,892 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:12:36,892 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:12:36,893 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:12:36,893 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:12:36,893 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:12:36,894 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:12:36,894 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:12:36,895 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:12:36,895 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:12:36,895 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:12:36,896 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:36,896 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:36,897 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:36,897 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:36,897 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:36,898 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:36,898 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:37,292 WARN [Listener at jenkins-hbase4.apache.org/35127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:12:37,294 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-13 23:12:37,296 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-13 23:12:40,126 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:40,126 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:40,129 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:40,929 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:45,717 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:48,069 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:52,161 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:53,524 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:12:53,532 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:12:53,542 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-13 23:12:53,542 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:12:53,542 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:12:53,543 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:53,546 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 23:12:53,546 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 23:12:53,546 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2c338a09 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:53,547 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 23:12:53,547 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/local-export-1689289940789/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 23:12:53,611 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-13 23:12:53,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-13 23:12:53,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:53,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 23:12:53,619 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289973619"}]},"ts":"1689289973619"} 2023-07-13 23:12:53,640 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-13 23:12:53,668 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-13 23:12:53,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e699ec2a4883744104938700238cf49, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65c35500d5fbd40312493c1c86f09818, UNASSIGN}] 2023-07-13 23:12:53,672 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65c35500d5fbd40312493c1c86f09818, UNASSIGN 2023-07-13 23:12:53,673 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e699ec2a4883744104938700238cf49, UNASSIGN 2023-07-13 23:12:53,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=65c35500d5fbd40312493c1c86f09818, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:53,681 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7e699ec2a4883744104938700238cf49, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:53,681 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289973680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289973680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289973680"}]},"ts":"1689289973680"} 2023-07-13 23:12:53,681 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289973680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289973680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289973680"}]},"ts":"1689289973680"} 2023-07-13 23:12:53,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 65c35500d5fbd40312493c1c86f09818, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:12:53,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 7e699ec2a4883744104938700238cf49, server=jenkins-hbase4.apache.org,34053,1689289892354}] 2023-07-13 23:12:53,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 23:12:53,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:53,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 65c35500d5fbd40312493c1c86f09818, disabling compactions & flushes 2023-07-13 23:12:53,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:53,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:53,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. after waiting 0 ms 2023-07-13 23:12:53,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:53,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7e699ec2a4883744104938700238cf49 2023-07-13 23:12:53,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7e699ec2a4883744104938700238cf49, disabling compactions & flushes 2023-07-13 23:12:53,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:53,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:53,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. after waiting 0 ms 2023-07-13 23:12:53,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:53,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:53,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:53,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:53,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818. 2023-07-13 23:12:53,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 65c35500d5fbd40312493c1c86f09818: 2023-07-13 23:12:53,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:53,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49. 2023-07-13 23:12:53,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7e699ec2a4883744104938700238cf49: 2023-07-13 23:12:53,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:53,883 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=65c35500d5fbd40312493c1c86f09818, regionState=CLOSED 2023-07-13 23:12:53,883 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289973883"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289973883"}]},"ts":"1689289973883"} 2023-07-13 23:12:53,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7e699ec2a4883744104938700238cf49 2023-07-13 23:12:53,884 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7e699ec2a4883744104938700238cf49, regionState=CLOSED 2023-07-13 23:12:53,884 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289973884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289973884"}]},"ts":"1689289973884"} 2023-07-13 23:12:53,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-13 23:12:53,889 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 65c35500d5fbd40312493c1c86f09818, server=jenkins-hbase4.apache.org,43615,1689289892304 in 201 msec 2023-07-13 23:12:53,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-13 23:12:53,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 7e699ec2a4883744104938700238cf49, server=jenkins-hbase4.apache.org,34053,1689289892354 in 201 msec 2023-07-13 23:12:53,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e699ec2a4883744104938700238cf49, UNASSIGN in 220 msec 2023-07-13 23:12:53,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-13 23:12:53,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65c35500d5fbd40312493c1c86f09818, UNASSIGN in 220 msec 2023-07-13 23:12:53,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289973893"}]},"ts":"1689289973893"} 2023-07-13 23:12:53,895 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-13 23:12:53,908 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-13 23:12:53,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 297 msec 2023-07-13 23:12:53,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 23:12:53,923 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-13 23:12:53,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-13 23:12:53,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:53,944 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:53,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-13 23:12:53,945 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:53,949 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-13 23:12:53,953 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:53,953 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:53,953 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:53,953 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:53,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 23:12:53,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 23:12:53,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 23:12:53,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 23:12:53,958 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49 2023-07-13 23:12:53,958 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:53,960 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/recovered.edits] 2023-07-13 23:12:53,960 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/recovered.edits] 2023-07-13 23:12:53,965 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/cf/3bd6578ad6fe4790a3c25a4280709f11 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/cf/3bd6578ad6fe4790a3c25a4280709f11 2023-07-13 23:12:53,966 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/cf/8651e3b240a9475393cfcc02252b3c31 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/cf/8651e3b240a9475393cfcc02252b3c31 2023-07-13 23:12:53,968 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:53,968 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:53,968 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:53,968 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:53,968 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:53,968 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:53,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-13 23:12:53,974 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:53,974 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:53,976 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818/recovered.edits/9.seqid 2023-07-13 23:12:53,977 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/65c35500d5fbd40312493c1c86f09818 2023-07-13 23:12:53,977 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49/recovered.edits/9.seqid 2023-07-13 23:12:53,978 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testConsecutiveExports/7e699ec2a4883744104938700238cf49 2023-07-13 23:12:53,978 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-13 23:12:53,978 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-13 23:12:53,979 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-13 23:12:53,983 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230713065bf04cdf81486ab1ec3d7a79e1ed1a to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230713065bf04cdf81486ab1ec3d7a79e1ed1a 2023-07-13 23:12:53,985 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713522671fc5c1e4ae28fd6e59bac6821d6 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713522671fc5c1e4ae28fd6e59bac6821d6 2023-07-13 23:12:53,986 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-13 23:12:53,994 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:54,001 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-13 23:12:54,004 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-13 23:12:54,005 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:54,005 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-13 23:12:54,005 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289974005"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:54,005 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289974005"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:54,007 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:12:54,007 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7e699ec2a4883744104938700238cf49, NAME => 'testtb-testConsecutiveExports,,1689289939457.7e699ec2a4883744104938700238cf49.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 65c35500d5fbd40312493c1c86f09818, NAME => 'testtb-testConsecutiveExports,1,1689289939457.65c35500d5fbd40312493c1c86f09818.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:12:54,008 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-13 23:12:54,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289974008"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:54,010 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-13 23:12:54,012 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:54,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 88 msec 2023-07-13 23:12:54,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-13 23:12:54,072 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-13 23:12:54,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-13 23:12:54,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:54,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-13 23:12:54,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-13 23:12:54,118 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 759), OpenFileDescriptor=895 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 389) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=3574 (was 3795) 2023-07-13 23:12:54,118 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-13 23:12:54,139 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=183, AvailableMemoryMB=3572 2023-07-13 23:12:54,139 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-13 23:12:54,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 23:12:54,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,153 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:12:54,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-13 23:12:54,154 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:12:54,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 23:12:54,157 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:12:54,158 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7 empty. 2023-07-13 23:12:54,158 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379 2023-07-13 23:12:54,159 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:12:54,159 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379 empty. 2023-07-13 23:12:54,160 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379 2023-07-13 23:12:54,160 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-13 23:12:54,184 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-13 23:12:54,186 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => e9d40cfbda45e3af11e5bbcf6ded70f7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:12:54,187 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 83f91c43255e06b504043c7623f63379, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:12:54,215 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:54,215 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing e9d40cfbda45e3af11e5bbcf6ded70f7, disabling compactions & flushes 2023-07-13 23:12:54,215 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,215 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,215 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. after waiting 0 ms 2023-07-13 23:12:54,215 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,215 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,215 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for e9d40cfbda45e3af11e5bbcf6ded70f7: 2023-07-13 23:12:54,224 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:54,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 83f91c43255e06b504043c7623f63379, disabling compactions & flushes 2023-07-13 23:12:54,225 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:54,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:54,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. after waiting 0 ms 2023-07-13 23:12:54,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:54,225 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:54,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 83f91c43255e06b504043c7623f63379: 2023-07-13 23:12:54,227 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:12:54,229 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289974228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289974228"}]},"ts":"1689289974228"} 2023-07-13 23:12:54,229 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289974228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289974228"}]},"ts":"1689289974228"} 2023-07-13 23:12:54,236 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:12:54,246 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:12:54,246 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289974246"}]},"ts":"1689289974246"} 2023-07-13 23:12:54,248 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-13 23:12:54,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 23:12:54,269 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:12:54,271 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:12:54,271 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:12:54,271 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:12:54,271 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:12:54,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e9d40cfbda45e3af11e5bbcf6ded70f7, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83f91c43255e06b504043c7623f63379, ASSIGN}] 2023-07-13 23:12:54,275 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e9d40cfbda45e3af11e5bbcf6ded70f7, ASSIGN 2023-07-13 23:12:54,275 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83f91c43255e06b504043c7623f63379, ASSIGN 2023-07-13 23:12:54,279 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e9d40cfbda45e3af11e5bbcf6ded70f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43615,1689289892304; forceNewPlan=false, retain=false 2023-07-13 23:12:54,279 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83f91c43255e06b504043c7623f63379, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34053,1689289892354; forceNewPlan=false, retain=false 2023-07-13 23:12:54,429 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:12:54,433 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e9d40cfbda45e3af11e5bbcf6ded70f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,433 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=83f91c43255e06b504043c7623f63379, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,433 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289974433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289974433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289974433"}]},"ts":"1689289974433"} 2023-07-13 23:12:54,433 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289974433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289974433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289974433"}]},"ts":"1689289974433"} 2023-07-13 23:12:54,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure e9d40cfbda45e3af11e5bbcf6ded70f7, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:12:54,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 83f91c43255e06b504043c7623f63379, server=jenkins-hbase4.apache.org,34053,1689289892354}] 2023-07-13 23:12:54,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 23:12:54,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9d40cfbda45e3af11e5bbcf6ded70f7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:12:54,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. service=AccessControlService 2023-07-13 23:12:54,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:54,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:12:54,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:54,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:12:54,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:12:54,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:54,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83f91c43255e06b504043c7623f63379, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:12:54,595 INFO [StoreOpener-e9d40cfbda45e3af11e5bbcf6ded70f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:12:54,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. service=AccessControlService 2023-07-13 23:12:54,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:54,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 83f91c43255e06b504043c7623f63379 2023-07-13 23:12:54,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:54,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83f91c43255e06b504043c7623f63379 2023-07-13 23:12:54,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83f91c43255e06b504043c7623f63379 2023-07-13 23:12:54,597 DEBUG [StoreOpener-e9d40cfbda45e3af11e5bbcf6ded70f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/cf 2023-07-13 23:12:54,597 DEBUG [StoreOpener-e9d40cfbda45e3af11e5bbcf6ded70f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/cf 2023-07-13 23:12:54,597 INFO [StoreOpener-83f91c43255e06b504043c7623f63379-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 83f91c43255e06b504043c7623f63379 2023-07-13 23:12:54,598 INFO [StoreOpener-e9d40cfbda45e3af11e5bbcf6ded70f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9d40cfbda45e3af11e5bbcf6ded70f7 columnFamilyName cf 2023-07-13 23:12:54,600 INFO [StoreOpener-e9d40cfbda45e3af11e5bbcf6ded70f7-1] regionserver.HStore(310): Store=e9d40cfbda45e3af11e5bbcf6ded70f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:54,600 DEBUG [StoreOpener-83f91c43255e06b504043c7623f63379-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/cf 2023-07-13 23:12:54,600 DEBUG [StoreOpener-83f91c43255e06b504043c7623f63379-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/cf 2023-07-13 23:12:54,601 INFO [StoreOpener-83f91c43255e06b504043c7623f63379-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83f91c43255e06b504043c7623f63379 columnFamilyName cf 2023-07-13 23:12:54,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:12:54,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:12:54,602 INFO [StoreOpener-83f91c43255e06b504043c7623f63379-1] regionserver.HStore(310): Store=83f91c43255e06b504043c7623f63379/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:54,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379 2023-07-13 23:12:54,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379 2023-07-13 23:12:54,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:12:54,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83f91c43255e06b504043c7623f63379 2023-07-13 23:12:54,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:54,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e9d40cfbda45e3af11e5bbcf6ded70f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61852959, jitterRate=-0.07831908762454987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:54,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e9d40cfbda45e3af11e5bbcf6ded70f7: 2023-07-13 23:12:54,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7., pid=60, masterSystemTime=1689289974589 2023-07-13 23:12:54,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:54,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83f91c43255e06b504043c7623f63379; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65782893, jitterRate=-0.01975850760936737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:54,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83f91c43255e06b504043c7623f63379: 2023-07-13 23:12:54,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379., pid=61, masterSystemTime=1689289974590 2023-07-13 23:12:54,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,611 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e9d40cfbda45e3af11e5bbcf6ded70f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,611 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289974611"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289974611"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289974611"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289974611"}]},"ts":"1689289974611"} 2023-07-13 23:12:54,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:54,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:54,612 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=83f91c43255e06b504043c7623f63379, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,612 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289974612"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289974612"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289974612"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289974612"}]},"ts":"1689289974612"} 2023-07-13 23:12:54,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-13 23:12:54,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure e9d40cfbda45e3af11e5bbcf6ded70f7, server=jenkins-hbase4.apache.org,43615,1689289892304 in 178 msec 2023-07-13 23:12:54,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-13 23:12:54,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 83f91c43255e06b504043c7623f63379, server=jenkins-hbase4.apache.org,34053,1689289892354 in 178 msec 2023-07-13 23:12:54,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e9d40cfbda45e3af11e5bbcf6ded70f7, ASSIGN in 347 msec 2023-07-13 23:12:54,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-13 23:12:54,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83f91c43255e06b504043c7623f63379, ASSIGN in 348 msec 2023-07-13 23:12:54,625 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:12:54,625 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289974625"}]},"ts":"1689289974625"} 2023-07-13 23:12:54,627 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-13 23:12:54,629 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:12:54,629 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-13 23:12:54,631 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 23:12:54,633 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:54,633 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:54,633 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:54,633 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:54,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 492 msec 2023-07-13 23:12:54,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 23:12:54,760 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-13 23:12:54,762 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,763 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,765 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:54,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:54,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289974792 (current time:1689289974792). 2023-07-13 23:12:54,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:54,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x160ce597 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:54,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@431bbf41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:54,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:54,815 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:54,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x160ce597 to 127.0.0.1:63739 2023-07-13 23:12:54,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:54,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x3811a3ba to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:54,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4940c972, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:54,831 DEBUG [hconnection-0x573f86ac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:54,832 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:54,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:54,839 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:54,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3811a3ba to 127.0.0.1:63739 2023-07-13 23:12:54,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:54,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 23:12:54,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:54,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:54,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:54,846 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:54,847 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689290574847 2023-07-13 23:12:54,847 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:54,848 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:54,848 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:54,850 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:54,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:54,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-13 23:12:54,852 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:54,852 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689290574852 2023-07-13 23:12:54,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,865 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-13 23:12:54,866 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:54,867 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-13 23:12:54,867 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-13 23:12:54,867 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,867 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,868 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:54,868 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:54,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:54,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:54,868 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,868 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:54,869 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:54,869 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,870 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,870 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:54,870 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:54,871 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:54,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:54,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:54,873 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:54,874 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:54,874 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:54,874 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:54,874 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:54,874 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:54,874 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:54,876 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,876 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:54,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:54,876 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,876 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:54,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:54,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 23:12:54,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e4c93ee[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:54,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 23:12:54,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e4c93ee[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:54,882 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-13 23:12:54,882 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,884 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,884 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,884 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,884 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,884 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:54,884 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:54,884 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:54,885 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:12:54,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,885 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:54,885 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:54,885 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. started... 2023-07-13 23:12:54,885 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:54,885 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:54,886 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,886 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83f91c43255e06b504043c7623f63379: 2023-07-13 23:12:54,886 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:54,886 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,886 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:54,886 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,886 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. started... 2023-07-13 23:12:54,886 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:54,886 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:54,886 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:54,886 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9d40cfbda45e3af11e5bbcf6ded70f7: 2023-07-13 23:12:54,887 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,887 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:54,887 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:54,890 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:54,891 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:54,891 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:54,906 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. completed. 2023-07-13 23:12:54,906 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. completed. 2023-07-13 23:12:54,906 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:54,906 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:54,906 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:12:54,908 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,908 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:54,908 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:54,908 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:54,908 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:54,908 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:54,909 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:54,908 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34053,1689289892354': 2023-07-13 23:12:54,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-13 23:12:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:12:54,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-13 23:12:54,916 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-13 23:12:54,917 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:54,917 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:54,917 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,917 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:54,919 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,919 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:54,919 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:54,919 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,919 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,920 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:54,920 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:54,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,920 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,921 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:54,921 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:54,923 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,923 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,923 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,926 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,926 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,926 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:54,926 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,926 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:54,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:54,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:54,926 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:54,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,926 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,927 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,926 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:54,927 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:54,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:54,926 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:54,927 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:54,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:54,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:54,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,927 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:54,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:12:54,927 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,928 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:54,928 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:54,928 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,928 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:54,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:54,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 23:12:54,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-13 23:12:54,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:54,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:54,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:54,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:54,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,949 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:54,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:54,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:54,950 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:54,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,981 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-13 23:12:54,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,982 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:54,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689289974847Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689289974942 (+95 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689289974942Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689289974942Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689289974945 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689289974956 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689289974981 (+25 ms) 2023-07-13 23:12:54,985 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:54,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 137 msec 2023-07-13 23:12:55,150 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:55,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:55,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:55,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:55,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34053] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:55,158 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,158 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:55,158 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:55,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:55,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289975168 (current time:1689289975168). 2023-07-13 23:12:55,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:55,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x0d2c4492 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:55,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@553ef89c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:55,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:55,180 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d2c4492 to 127.0.0.1:63739 2023-07-13 23:12:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x386f0f1f to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:55,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5788d454, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:55,196 DEBUG [hconnection-0x75502c21-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:55,200 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:55,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:55,207 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:55,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x386f0f1f to 127.0.0.1:63739 2023-07-13 23:12:55,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:55,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 23:12:55,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:55,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:55,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:55,212 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:55,213 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689290575213 2023-07-13 23:12:55,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:55,213 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,214 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:55,214 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:55,215 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:55,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:55,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-07-13 23:12:55,217 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:55,217 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689290575217 2023-07-13 23:12:55,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,228 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-13 23:12:55,228 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:55,229 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-13 23:12:55,229 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-13 23:12:55,230 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,230 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,231 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:55,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:55,231 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:55,231 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:55,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:55,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:55,232 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,234 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,235 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,238 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,238 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 23:12:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 23:12:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 23:12:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:55,252 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:55,252 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:55,252 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:55,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,256 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:55,256 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:55,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,255 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:55,258 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:55,258 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:55,258 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:55,258 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:55,257 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:55,261 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,261 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:55,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:55,264 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,264 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:55,264 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,264 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:55,264 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,264 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,264 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:55,265 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,265 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:55,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 23:12:55,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e24f42[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:55,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:55,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:55,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:55,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:55,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:55,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 23:12:55,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e24f42[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:55,270 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-13 23:12:55,270 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,271 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,271 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,271 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,271 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:55,271 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:12:55,272 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,272 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:55,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:55,272 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:55,272 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:55,273 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. started... 2023-07-13 23:12:55,273 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. started... 2023-07-13 23:12:55,273 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e9d40cfbda45e3af11e5bbcf6ded70f7 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-13 23:12:55,273 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 83f91c43255e06b504043c7623f63379 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-13 23:12:55,274 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:55,274 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:55,274 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:55,314 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:55,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:55,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:55,316 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:55,336 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230713bcd4edead0bb45e0adbc9afb5d6008a8 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230713bcd4edead0bb45e0adbc9afb5d6008a8 2023-07-13 23:12:55,365 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230713caf3e84e32d944f5b5c1b833191c8723 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713caf3e84e32d944f5b5c1b833191c8723 2023-07-13 23:12:55,366 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/.tmp/cf/1d2ccddfd7ee44c5bed5b687679bfd4b 2023-07-13 23:12:55,372 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/.tmp/cf/1d2ccddfd7ee44c5bed5b687679bfd4b as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/cf/1d2ccddfd7ee44c5bed5b687679bfd4b 2023-07-13 23:12:55,378 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/cf/1d2ccddfd7ee44c5bed5b687679bfd4b, entries=46, sequenceid=6, filesize=13.4 K 2023-07-13 23:12:55,379 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 83f91c43255e06b504043c7623f63379 in 106ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:55,379 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-13 23:12:55,379 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83f91c43255e06b504043c7623f63379: 2023-07-13 23:12:55,379 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,379 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:55,379 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/cf/1d2ccddfd7ee44c5bed5b687679bfd4b] hfiles 2023-07-13 23:12:55,380 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/cf/1d2ccddfd7ee44c5bed5b687679bfd4b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,391 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/.tmp/cf/af2640d30a1b44b2a41464deb87b754d 2023-07-13 23:12:55,397 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/.tmp/cf/af2640d30a1b44b2a41464deb87b754d as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/cf/af2640d30a1b44b2a41464deb87b754d 2023-07-13 23:12:55,402 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. completed. 2023-07-13 23:12:55,402 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:12:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:55,402 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/cf/af2640d30a1b44b2a41464deb87b754d, entries=4, sequenceid=6, filesize=5.6 K 2023-07-13 23:12:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:55,403 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,403 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:55,403 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:12:55,403 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for e9d40cfbda45e3af11e5bbcf6ded70f7 in 130ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:55,405 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9d40cfbda45e3af11e5bbcf6ded70f7: 2023-07-13 23:12:55,406 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,406 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:55,406 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,406 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/cf/af2640d30a1b44b2a41464deb87b754d] hfiles 2023-07-13 23:12:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:55,406 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/cf/af2640d30a1b44b2a41464deb87b754d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,406 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:55,406 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:55,406 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34053,1689289892354': 2023-07-13 23:12:55,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-13 23:12:55,426 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. completed. 2023-07-13 23:12:55,426 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:12:55,426 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:55,426 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:55,426 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,426 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:55,426 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:12:55,429 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:55,429 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,429 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:55,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:55,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:55,429 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:55,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:55,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:55,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:55,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:12:55,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-13 23:12:55,441 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-13 23:12:55,441 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:55,441 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:55,441 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,441 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:55,446 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:55,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:55,446 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:55,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:55,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:55,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,447 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:55,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:55,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:55,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:55,447 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:55,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:55,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:55,451 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:55,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,453 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,453 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:55,453 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:55,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:55,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:55,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:55,457 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:55,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:55,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:55,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:55,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:55,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:12:55,457 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:55,460 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,460 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:55,460 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:55,460 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,460 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:55,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:55,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230713bcd4edead0bb45e0adbc9afb5d6008a8, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713caf3e84e32d944f5b5c1b833191c8723] mob files 2023-07-13 23:12:55,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230713bcd4edead0bb45e0adbc9afb5d6008a8 2023-07-13 23:12:55,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713caf3e84e32d944f5b5c1b833191c8723 2023-07-13 23:12:55,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,516 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:55,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:55,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:55,517 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:12:55,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-13 23:12:55,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,531 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:55,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689289975213Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689289975475 (+262 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689289975475Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689289975475Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689289975483 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689289975500 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689289975531 (+31 ms) 2023-07-13 23:12:55,535 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:55,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 321 msec 2023-07-13 23:12:55,817 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:55,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:55,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:55,854 DEBUG [Listener at jenkins-hbase4.apache.org/35127] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:12:55,862 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:12:55,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34053] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 23:12:55,865 DEBUG [Listener at jenkins-hbase4.apache.org/35127] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:12:55,873 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:12:55,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37295] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 23:12:55,874 DEBUG [Listener at jenkins-hbase4.apache.org/35127] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:12:55,881 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:12:55,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43615] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 23:12:55,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:12:55,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:55,888 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:12:55,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-13 23:12:55,889 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:12:55,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 23:12:55,905 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:55,913 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a empty. 2023-07-13 23:12:55,914 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:55,914 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:55,914 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085 empty. 2023-07-13 23:12:55,915 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:55,915 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-13 23:12:55,960 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-13 23:12:55,966 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => dc8861539a1cf63337bfc4866d2df87a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:12:55,966 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4a205a4885ebc89e6a6713b8ac1c4085, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:12:55,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:55,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 4a205a4885ebc89e6a6713b8ac1c4085, disabling compactions & flushes 2023-07-13 23:12:55,987 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:55,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:55,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. after waiting 0 ms 2023-07-13 23:12:55,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:55,987 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:55,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 4a205a4885ebc89e6a6713b8ac1c4085: 2023-07-13 23:12:55,989 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:55,989 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing dc8861539a1cf63337bfc4866d2df87a, disabling compactions & flushes 2023-07-13 23:12:55,990 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:55,990 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:55,990 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. after waiting 0 ms 2023-07-13 23:12:55,990 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:55,990 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:55,990 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for dc8861539a1cf63337bfc4866d2df87a: 2023-07-13 23:12:55,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 23:12:55,992 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:12:55,993 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289975993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289975993"}]},"ts":"1689289975993"} 2023-07-13 23:12:55,993 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289975993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289975993"}]},"ts":"1689289975993"} 2023-07-13 23:12:55,995 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:12:55,996 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:12:55,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289975996"}]},"ts":"1689289975996"} 2023-07-13 23:12:55,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-13 23:12:56,002 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:12:56,003 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:12:56,004 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:12:56,004 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:12:56,004 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:12:56,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dc8861539a1cf63337bfc4866d2df87a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a205a4885ebc89e6a6713b8ac1c4085, ASSIGN}] 2023-07-13 23:12:56,007 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a205a4885ebc89e6a6713b8ac1c4085, ASSIGN 2023-07-13 23:12:56,007 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dc8861539a1cf63337bfc4866d2df87a, ASSIGN 2023-07-13 23:12:56,009 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a205a4885ebc89e6a6713b8ac1c4085, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37295,1689289892196; forceNewPlan=false, retain=false 2023-07-13 23:12:56,009 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dc8861539a1cf63337bfc4866d2df87a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43615,1689289892304; forceNewPlan=false, retain=false 2023-07-13 23:12:56,159 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:12:56,163 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dc8861539a1cf63337bfc4866d2df87a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:56,163 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4a205a4885ebc89e6a6713b8ac1c4085, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:56,163 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289976162"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289976162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289976162"}]},"ts":"1689289976162"} 2023-07-13 23:12:56,163 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289976162"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289976162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289976162"}]},"ts":"1689289976162"} 2023-07-13 23:12:56,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure dc8861539a1cf63337bfc4866d2df87a, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:12:56,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 4a205a4885ebc89e6a6713b8ac1c4085, server=jenkins-hbase4.apache.org,37295,1689289892196}] 2023-07-13 23:12:56,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 23:12:56,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:56,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc8861539a1cf63337bfc4866d2df87a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.', STARTKEY => '', ENDKEY => '2'} 2023-07-13 23:12:56,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. service=AccessControlService 2023-07-13 23:12:56,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:56,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:56,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:56,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:56,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:56,335 INFO [StoreOpener-dc8861539a1cf63337bfc4866d2df87a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:56,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:56,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a205a4885ebc89e6a6713b8ac1c4085, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.', STARTKEY => '2', ENDKEY => ''} 2023-07-13 23:12:56,341 DEBUG [StoreOpener-dc8861539a1cf63337bfc4866d2df87a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/cf 2023-07-13 23:12:56,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. service=AccessControlService 2023-07-13 23:12:56,341 DEBUG [StoreOpener-dc8861539a1cf63337bfc4866d2df87a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/cf 2023-07-13 23:12:56,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:56,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:56,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,342 INFO [StoreOpener-dc8861539a1cf63337bfc4866d2df87a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc8861539a1cf63337bfc4866d2df87a columnFamilyName cf 2023-07-13 23:12:56,343 INFO [StoreOpener-dc8861539a1cf63337bfc4866d2df87a-1] regionserver.HStore(310): Store=dc8861539a1cf63337bfc4866d2df87a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:56,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:56,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:56,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:56,350 INFO [StoreOpener-4a205a4885ebc89e6a6713b8ac1c4085-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:56,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc8861539a1cf63337bfc4866d2df87a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63888785, jitterRate=-0.04798291623592377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:56,357 DEBUG [StoreOpener-4a205a4885ebc89e6a6713b8ac1c4085-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/cf 2023-07-13 23:12:56,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc8861539a1cf63337bfc4866d2df87a: 2023-07-13 23:12:56,357 DEBUG [StoreOpener-4a205a4885ebc89e6a6713b8ac1c4085-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/cf 2023-07-13 23:12:56,358 INFO [StoreOpener-4a205a4885ebc89e6a6713b8ac1c4085-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a205a4885ebc89e6a6713b8ac1c4085 columnFamilyName cf 2023-07-13 23:12:56,359 INFO [StoreOpener-4a205a4885ebc89e6a6713b8ac1c4085-1] regionserver.HStore(310): Store=4a205a4885ebc89e6a6713b8ac1c4085/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:56,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a., pid=69, masterSystemTime=1689289976323 2023-07-13 23:12:56,370 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dc8861539a1cf63337bfc4866d2df87a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:56,370 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289976370"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289976370"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289976370"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289976370"}]},"ts":"1689289976370"} 2023-07-13 23:12:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:56,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:56,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-13 23:12:56,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure dc8861539a1cf63337bfc4866d2df87a, server=jenkins-hbase4.apache.org,43615,1689289892304 in 204 msec 2023-07-13 23:12:56,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dc8861539a1cf63337bfc4866d2df87a, ASSIGN in 372 msec 2023-07-13 23:12:56,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:56,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a205a4885ebc89e6a6713b8ac1c4085; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71160573, jitterRate=0.06037516891956329}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:56,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a205a4885ebc89e6a6713b8ac1c4085: 2023-07-13 23:12:56,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085., pid=70, masterSystemTime=1689289976324 2023-07-13 23:12:56,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:56,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:56,383 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4a205a4885ebc89e6a6713b8ac1c4085, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:56,383 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289976383"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289976383"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289976383"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289976383"}]},"ts":"1689289976383"} 2023-07-13 23:12:56,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-13 23:12:56,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 4a205a4885ebc89e6a6713b8ac1c4085, server=jenkins-hbase4.apache.org,37295,1689289892196 in 215 msec 2023-07-13 23:12:56,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-13 23:12:56,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a205a4885ebc89e6a6713b8ac1c4085, ASSIGN in 386 msec 2023-07-13 23:12:56,394 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:12:56,394 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289976394"}]},"ts":"1689289976394"} 2023-07-13 23:12:56,395 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-13 23:12:56,401 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:12:56,402 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-13 23:12:56,404 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-13 23:12:56,406 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:56,406 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:56,406 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:56,406 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:56,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:56,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:56,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:56,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:56,409 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:56,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:56,409 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:56,409 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:56,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 524 msec 2023-07-13 23:12:56,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 23:12:56,493 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-13 23:12:56,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions dc8861539a1cf63337bfc4866d2df87a, 4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dc8861539a1cf63337bfc4866d2df87a, 4a205a4885ebc89e6a6713b8ac1c4085], force=true 2023-07-13 23:12:56,528 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dc8861539a1cf63337bfc4866d2df87a, 4a205a4885ebc89e6a6713b8ac1c4085], force=true 2023-07-13 23:12:56,528 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dc8861539a1cf63337bfc4866d2df87a, 4a205a4885ebc89e6a6713b8ac1c4085], force=true 2023-07-13 23:12:56,528 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dc8861539a1cf63337bfc4866d2df87a, 4a205a4885ebc89e6a6713b8ac1c4085], force=true 2023-07-13 23:12:56,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:56,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dc8861539a1cf63337bfc4866d2df87a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a205a4885ebc89e6a6713b8ac1c4085, UNASSIGN}] 2023-07-13 23:12:56,556 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a205a4885ebc89e6a6713b8ac1c4085, UNASSIGN 2023-07-13 23:12:56,557 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dc8861539a1cf63337bfc4866d2df87a, UNASSIGN 2023-07-13 23:12:56,557 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4a205a4885ebc89e6a6713b8ac1c4085, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:56,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289976557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289976557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289976557"}]},"ts":"1689289976557"} 2023-07-13 23:12:56,557 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=dc8861539a1cf63337bfc4866d2df87a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:56,558 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289976557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289976557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289976557"}]},"ts":"1689289976557"} 2023-07-13 23:12:56,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure dc8861539a1cf63337bfc4866d2df87a, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:12:56,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 4a205a4885ebc89e6a6713b8ac1c4085, server=jenkins-hbase4.apache.org,37295,1689289892196}] 2023-07-13 23:12:56,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:56,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:56,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a205a4885ebc89e6a6713b8ac1c4085, disabling compactions & flushes 2023-07-13 23:12:56,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc8861539a1cf63337bfc4866d2df87a, disabling compactions & flushes 2023-07-13 23:12:56,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:56,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:56,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:56,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:56,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. after waiting 0 ms 2023-07-13 23:12:56,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. after waiting 0 ms 2023-07-13 23:12:56,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:56,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:56,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4a205a4885ebc89e6a6713b8ac1c4085 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-13 23:12:56,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing dc8861539a1cf63337bfc4866d2df87a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-13 23:12:56,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/.tmp/cf/f09f2a7828534c79b060faffdd3db714 2023-07-13 23:12:56,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/.tmp/cf/2120dd43e2614e2dbe66ab28fdb11b78 2023-07-13 23:12:56,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/.tmp/cf/f09f2a7828534c79b060faffdd3db714 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/cf/f09f2a7828534c79b060faffdd3db714 2023-07-13 23:12:56,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/.tmp/cf/2120dd43e2614e2dbe66ab28fdb11b78 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/cf/2120dd43e2614e2dbe66ab28fdb11b78 2023-07-13 23:12:56,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/cf/f09f2a7828534c79b060faffdd3db714, entries=1, sequenceid=5, filesize=4.7 K 2023-07-13 23:12:56,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 4a205a4885ebc89e6a6713b8ac1c4085 in 39ms, sequenceid=5, compaction requested=false 2023-07-13 23:12:56,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-13 23:12:56,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/cf/2120dd43e2614e2dbe66ab28fdb11b78, entries=1, sequenceid=5, filesize=4.7 K 2023-07-13 23:12:56,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for dc8861539a1cf63337bfc4866d2df87a in 48ms, sequenceid=5, compaction requested=false 2023-07-13 23:12:56,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-13 23:12:56,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:56,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085. 2023-07-13 23:12:56,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a205a4885ebc89e6a6713b8ac1c4085: 2023-07-13 23:12:56,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:12:56,772 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4a205a4885ebc89e6a6713b8ac1c4085, regionState=CLOSED 2023-07-13 23:12:56,772 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289976772"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289976772"}]},"ts":"1689289976772"} 2023-07-13 23:12:56,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-13 23:12:56,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:56,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a. 2023-07-13 23:12:56,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc8861539a1cf63337bfc4866d2df87a: 2023-07-13 23:12:56,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:12:56,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-13 23:12:56,776 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=dc8861539a1cf63337bfc4866d2df87a, regionState=CLOSED 2023-07-13 23:12:56,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 4a205a4885ebc89e6a6713b8ac1c4085, server=jenkins-hbase4.apache.org,37295,1689289892196 in 213 msec 2023-07-13 23:12:56,777 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289976776"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289976776"}]},"ts":"1689289976776"} 2023-07-13 23:12:56,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a205a4885ebc89e6a6713b8ac1c4085, UNASSIGN in 222 msec 2023-07-13 23:12:56,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-13 23:12:56,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure dc8861539a1cf63337bfc4866d2df87a, server=jenkins-hbase4.apache.org,43615,1689289892304 in 223 msec 2023-07-13 23:12:56,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-13 23:12:56,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dc8861539a1cf63337bfc4866d2df87a, UNASSIGN in 239 msec 2023-07-13 23:12:56,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:56,854 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-13 23:12:56,857 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975884.dc8861539a1cf63337bfc4866d2df87a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:56,857 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289975884.4a205a4885ebc89e6a6713b8ac1c4085.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:56,857 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:56,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c1bcc9658449b5b47339e9623644d31, ASSIGN}] 2023-07-13 23:12:56,927 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c1bcc9658449b5b47339e9623644d31, ASSIGN 2023-07-13 23:12:56,928 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c1bcc9658449b5b47339e9623644d31, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43615,1689289892304; forceNewPlan=false, retain=false 2023-07-13 23:12:57,079 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 23:12:57,081 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0c1bcc9658449b5b47339e9623644d31, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:57,081 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689289977081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289977081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289977081"}]},"ts":"1689289977081"} 2023-07-13 23:12:57,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 0c1bcc9658449b5b47339e9623644d31, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:12:57,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:57,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. 2023-07-13 23:12:57,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c1bcc9658449b5b47339e9623644d31, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:12:57,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. service=AccessControlService 2023-07-13 23:12:57,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:57,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:12:57,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:57,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:12:57,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:12:57,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/.regioninfo 2023-07-13 23:12:57,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:57,652 INFO [StoreOpener-0c1bcc9658449b5b47339e9623644d31-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:12:57,653 DEBUG [StoreOpener-0c1bcc9658449b5b47339e9623644d31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf 2023-07-13 23:12:57,653 DEBUG [StoreOpener-0c1bcc9658449b5b47339e9623644d31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf 2023-07-13 23:12:57,654 INFO [StoreOpener-0c1bcc9658449b5b47339e9623644d31-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c1bcc9658449b5b47339e9623644d31 columnFamilyName cf 2023-07-13 23:12:57,691 DEBUG [StoreOpener-0c1bcc9658449b5b47339e9623644d31-1] regionserver.HStore(539): loaded hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/2120dd43e2614e2dbe66ab28fdb11b78.dc8861539a1cf63337bfc4866d2df87a->hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/cf/2120dd43e2614e2dbe66ab28fdb11b78-top 2023-07-13 23:12:57,701 DEBUG [StoreOpener-0c1bcc9658449b5b47339e9623644d31-1] regionserver.HStore(539): loaded hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/f09f2a7828534c79b060faffdd3db714.4a205a4885ebc89e6a6713b8ac1c4085->hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/cf/f09f2a7828534c79b060faffdd3db714-top 2023-07-13 23:12:57,702 INFO [StoreOpener-0c1bcc9658449b5b47339e9623644d31-1] regionserver.HStore(310): Store=0c1bcc9658449b5b47339e9623644d31/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:57,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:12:57,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:12:57,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:12:57,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c1bcc9658449b5b47339e9623644d31; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69149762, jitterRate=0.030411750078201294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:57,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c1bcc9658449b5b47339e9623644d31: 2023-07-13 23:12:57,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31., pid=77, masterSystemTime=1689289977235 2023-07-13 23:12:57,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.,because compaction is disabled. 2023-07-13 23:12:57,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. 2023-07-13 23:12:57,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. 2023-07-13 23:12:57,716 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0c1bcc9658449b5b47339e9623644d31, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:57,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689289977715"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289977715"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289977715"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289977715"}]},"ts":"1689289977715"} 2023-07-13 23:12:57,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-13 23:12:57,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 0c1bcc9658449b5b47339e9623644d31, server=jenkins-hbase4.apache.org,43615,1689289892304 in 635 msec 2023-07-13 23:12:57,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-13 23:12:57,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c1bcc9658449b5b47339e9623644d31, ASSIGN in 798 msec 2023-07-13 23:12:57,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dc8861539a1cf63337bfc4866d2df87a, 4a205a4885ebc89e6a6713b8ac1c4085], force=true in 1.2060 sec 2023-07-13 23:12:58,290 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:58,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:58,639 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-13 23:12:58,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 23:12:58,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289978640 (current time:1689289978640). 2023-07-13 23:12:58,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:58,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x377a425f to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:58,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54f1853f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:58,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:58,651 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:58,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x377a425f to 127.0.0.1:63739 2023-07-13 23:12:58,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:58,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x05b441f0 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:58,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60b993a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:58,676 DEBUG [hconnection-0x38b93af6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:58,680 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:58,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:58,690 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:58,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05b441f0 to 127.0.0.1:63739 2023-07-13 23:12:58,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:58,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-13 23:12:58,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:58,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 23:12:58,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 23:12:58,697 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 23:12:58,698 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689290578698 2023-07-13 23:12:58,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 23:12:58,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,703 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:58,703 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:58,705 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 23:12:58,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 23:12:58,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 11 msec 2023-07-13 23:12:58,710 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 23:12:58,711 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689290578711 2023-07-13 23:12:58,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,724 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-13 23:12:58,724 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:58,725 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-13 23:12:58,725 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-13 23:12:58,726 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,726 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,727 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:58,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:58,728 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,728 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:58,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:58,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:58,728 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:58,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:58,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:58,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:58,728 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,728 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:58,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 23:12:58,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 23:12:58,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 23:12:58,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 23:12:58,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 23:12:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:58,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 23:12:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 23:12:58,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 23:12:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 23:12:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 23:12:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 23:12:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 23:12:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 23:12:58,732 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 23:12:58,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 23:12:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 23:12:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 23:12:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 23:12:58,737 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,737 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,739 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,739 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:58,739 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,739 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,739 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:58,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-13 23:12:58,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b405480[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:58,743 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-13 23:12:58,743 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,745 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,745 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,745 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,746 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 23:12:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,746 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 23:12:58,746 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 23:12:58,746 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:12:58,746 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,746 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,746 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 23:12:58,746 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 23:12:58,746 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:12:58,747 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:58,747 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:58,747 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. 2023-07-13 23:12:58,747 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. started... 2023-07-13 23:12:58,749 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c1bcc9658449b5b47339e9623644d31: 2023-07-13 23:12:58,749 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 23:12:58,749 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:58,749 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 23:12:58,749 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,749 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:58,750 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/2120dd43e2614e2dbe66ab28fdb11b78.dc8861539a1cf63337bfc4866d2df87a->hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/cf/2120dd43e2614e2dbe66ab28fdb11b78-top, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/f09f2a7828534c79b060faffdd3db714.4a205a4885ebc89e6a6713b8ac1c4085->hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/cf/f09f2a7828534c79b060faffdd3db714-top] hfiles 2023-07-13 23:12:58,750 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/2120dd43e2614e2dbe66ab28fdb11b78.dc8861539a1cf63337bfc4866d2df87a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,751 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 23:12:58,752 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:58,752 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 23:12:58,756 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/f09f2a7828534c79b060faffdd3db714.4a205a4885ebc89e6a6713b8ac1c4085 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,771 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. completed. 2023-07-13 23:12:58,771 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. 2023-07-13 23:12:58,771 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:58,771 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:58,772 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,772 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 23:12:58,772 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:12:58,779 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:58,779 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 23:12:58,780 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:58,780 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 23:12:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:58,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:58,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:12:58,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-13 23:12:58,790 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-13 23:12:58,790 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:58,790 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:58,790 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,791 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:58,794 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,794 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,794 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:58,794 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:58,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:58,794 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:58,794 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,795 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:58,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:58,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:58,796 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:58,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:58,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:58,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:58,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:58,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:58,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,797 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:58,798 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:58,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,803 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:58,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:58,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 23:12:58,804 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:58,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:58,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,805 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,805 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:58,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:58,805 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:58,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:58,810 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:58,810 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:58,810 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:58,810 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:58,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:58,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:58,811 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:58,811 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:58,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:58,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:58,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:58,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:58,812 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:12:58,812 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,813 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:58,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:58,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:58,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:59,005 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:59,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 23:12:59,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:59,016 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:12:59,047 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-13 23:12:59,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:59,048 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:59,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689289978698Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689289978814 (+116 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689289978815 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689289978825 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689289978898 (+73 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689289979047 (+149 ms) 2023-07-13 23:12:59,053 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 23:12:59,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 350 msec 2023-07-13 23:12:59,316 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:59,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 23:12:59,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:59,318 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318 2023-07-13 23:12:59,318 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33689, tgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318, rawTgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318, srcFsUri=hdfs://localhost:33689, srcDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:12:59,352 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:12:59,352 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1551842386_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:59,352 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29, snapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-13 23:12:59,366 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:59,416 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:59,417 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:59,417 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:59,418 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:59,524 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:13:00,613 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-3251360350170134229.jar 2023-07-13 23:13:00,614 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:00,615 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:00,699 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-785302030029189638.jar 2023-07-13 23:13:00,699 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:00,700 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:00,700 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:00,701 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:00,701 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:00,702 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:00,703 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:13:00,703 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:13:00,704 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:13:00,704 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:13:00,704 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:13:00,705 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:13:00,707 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:13:00,707 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:13:00,708 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:13:00,708 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:13:00,709 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:00,710 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:00,711 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:00,711 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:00,711 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:00,712 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:00,713 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:02,846 WARN [Listener at jenkins-hbase4.apache.org/35127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:13:02,853 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-13 23:13:02,856 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-13 23:13:03,070 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:03,070 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:03,166 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:09,355 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:11,766 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:15,086 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:16,222 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:13:16,226 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:13:16,239 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,239 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:13:16,240 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:13:16,240 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,241 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-13 23:13:16,241 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-13 23:13:16,241 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,241 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-13 23:13:16,241 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289979318/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-13 23:13:16,249 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,255 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289996255"}]},"ts":"1689289996255"} 2023-07-13 23:13:16,257 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-13 23:13:16,259 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-13 23:13:16,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c1bcc9658449b5b47339e9623644d31, UNASSIGN}] 2023-07-13 23:13:16,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 23:13:16,262 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c1bcc9658449b5b47339e9623644d31, UNASSIGN 2023-07-13 23:13:16,263 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0c1bcc9658449b5b47339e9623644d31, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:16,263 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689289996263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289996263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289996263"}]},"ts":"1689289996263"} 2023-07-13 23:13:16,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 0c1bcc9658449b5b47339e9623644d31, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:13:16,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 23:13:16,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:13:16,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c1bcc9658449b5b47339e9623644d31, disabling compactions & flushes 2023-07-13 23:13:16,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. 2023-07-13 23:13:16,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. 2023-07-13 23:13:16,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. after waiting 0 ms 2023-07-13 23:13:16,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. 2023-07-13 23:13:16,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-13 23:13:16,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:16,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31. 2023-07-13 23:13:16,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c1bcc9658449b5b47339e9623644d31: 2023-07-13 23:13:16,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:13:16,444 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0c1bcc9658449b5b47339e9623644d31, regionState=CLOSED 2023-07-13 23:13:16,445 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689289996444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289996444"}]},"ts":"1689289996444"} 2023-07-13 23:13:16,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-13 23:13:16,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 0c1bcc9658449b5b47339e9623644d31, server=jenkins-hbase4.apache.org,43615,1689289892304 in 179 msec 2023-07-13 23:13:16,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-13 23:13:16,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c1bcc9658449b5b47339e9623644d31, UNASSIGN in 197 msec 2023-07-13 23:13:16,462 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289996462"}]},"ts":"1689289996462"} 2023-07-13 23:13:16,464 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-13 23:13:16,465 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-13 23:13:16,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 217 msec 2023-07-13 23:13:16,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 23:13:16,564 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-13 23:13:16,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,568 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,569 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,570 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,573 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,573 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,573 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 23:13:16,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 23:13:16,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 23:13:16,574 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,576 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:13:16,576 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:13:16,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 23:13:16,578 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/recovered.edits] 2023-07-13 23:13:16,579 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/recovered.edits] 2023-07-13 23:13:16,579 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,579 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:16,579 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,579 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:16,579 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,580 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:16,580 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,580 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:16,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-13 23:13:16,582 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:13:16,584 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/recovered.edits] 2023-07-13 23:13:16,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:16,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:16,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:16,587 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/cf/2120dd43e2614e2dbe66ab28fdb11b78 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/cf/2120dd43e2614e2dbe66ab28fdb11b78 2023-07-13 23:13:16,588 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:16,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/cf/f09f2a7828534c79b060faffdd3db714 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/cf/f09f2a7828534c79b060faffdd3db714 2023-07-13 23:13:16,594 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/recovered.edits/8.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a/recovered.edits/8.seqid 2023-07-13 23:13:16,595 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:13:16,598 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/recovered.edits/8.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085/recovered.edits/8.seqid 2023-07-13 23:13:16,598 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/2120dd43e2614e2dbe66ab28fdb11b78.dc8861539a1cf63337bfc4866d2df87a to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/2120dd43e2614e2dbe66ab28fdb11b78.dc8861539a1cf63337bfc4866d2df87a 2023-07-13 23:13:16,598 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:13:16,599 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/f09f2a7828534c79b060faffdd3db714.4a205a4885ebc89e6a6713b8ac1c4085 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/cf/f09f2a7828534c79b060faffdd3db714.4a205a4885ebc89e6a6713b8ac1c4085 2023-07-13 23:13:16,603 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/recovered.edits/12.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31/recovered.edits/12.seqid 2023-07-13 23:13:16,604 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c1bcc9658449b5b47339e9623644d31 2023-07-13 23:13:16,604 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-13 23:13:16,607 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,610 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-13 23:13:16,612 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-13 23:13:16,613 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,613 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-13 23:13:16,613 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289996613"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:16,615 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-13 23:13:16,615 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0c1bcc9658449b5b47339e9623644d31, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289975885.0c1bcc9658449b5b47339e9623644d31.', STARTKEY => '', ENDKEY => ''}] 2023-07-13 23:13:16,615 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-13 23:13:16,615 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289996615"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:16,617 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-13 23:13:16,619 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:16,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 54 msec 2023-07-13 23:13:16,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-13 23:13:16,683 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-13 23:13:16,684 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:16,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:16,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:16,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 23:13:16,691 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289996690"}]},"ts":"1689289996690"} 2023-07-13 23:13:16,692 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-13 23:13:16,694 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-13 23:13:16,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e9d40cfbda45e3af11e5bbcf6ded70f7, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83f91c43255e06b504043c7623f63379, UNASSIGN}] 2023-07-13 23:13:16,697 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e9d40cfbda45e3af11e5bbcf6ded70f7, UNASSIGN 2023-07-13 23:13:16,697 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83f91c43255e06b504043c7623f63379, UNASSIGN 2023-07-13 23:13:16,698 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e9d40cfbda45e3af11e5bbcf6ded70f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:16,698 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=83f91c43255e06b504043c7623f63379, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:16,698 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289996698"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289996698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289996698"}]},"ts":"1689289996698"} 2023-07-13 23:13:16,698 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289996698"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289996698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289996698"}]},"ts":"1689289996698"} 2023-07-13 23:13:16,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 83f91c43255e06b504043c7623f63379, server=jenkins-hbase4.apache.org,34053,1689289892354}] 2023-07-13 23:13:16,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure e9d40cfbda45e3af11e5bbcf6ded70f7, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:13:16,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 23:13:16,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 83f91c43255e06b504043c7623f63379 2023-07-13 23:13:16,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:13:16,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83f91c43255e06b504043c7623f63379, disabling compactions & flushes 2023-07-13 23:13:16,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e9d40cfbda45e3af11e5bbcf6ded70f7, disabling compactions & flushes 2023-07-13 23:13:16,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:13:16,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:13:16,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:13:16,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:13:16,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. after waiting 0 ms 2023-07-13 23:13:16,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. after waiting 0 ms 2023-07-13 23:13:16,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:13:16,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:13:16,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:16,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:16,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7. 2023-07-13 23:13:16,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e9d40cfbda45e3af11e5bbcf6ded70f7: 2023-07-13 23:13:16,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:16,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:16,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379. 2023-07-13 23:13:16,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83f91c43255e06b504043c7623f63379: 2023-07-13 23:13:16,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:13:16,872 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e9d40cfbda45e3af11e5bbcf6ded70f7, regionState=CLOSED 2023-07-13 23:13:16,872 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289996871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289996871"}]},"ts":"1689289996871"} 2023-07-13 23:13:16,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 83f91c43255e06b504043c7623f63379 2023-07-13 23:13:16,872 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=83f91c43255e06b504043c7623f63379, regionState=CLOSED 2023-07-13 23:13:16,873 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289996872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289996872"}]},"ts":"1689289996872"} 2023-07-13 23:13:16,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-13 23:13:16,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 83f91c43255e06b504043c7623f63379, server=jenkins-hbase4.apache.org,34053,1689289892354 in 174 msec 2023-07-13 23:13:16,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-13 23:13:16,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure e9d40cfbda45e3af11e5bbcf6ded70f7, server=jenkins-hbase4.apache.org,43615,1689289892304 in 174 msec 2023-07-13 23:13:16,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83f91c43255e06b504043c7623f63379, UNASSIGN in 181 msec 2023-07-13 23:13:16,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-13 23:13:16,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e9d40cfbda45e3af11e5bbcf6ded70f7, UNASSIGN in 183 msec 2023-07-13 23:13:16,880 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289996880"}]},"ts":"1689289996880"} 2023-07-13 23:13:16,882 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-13 23:13:16,883 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-13 23:13:16,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 203 msec 2023-07-13 23:13:16,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 23:13:16,992 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-13 23:13:16,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:16,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:16,996 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:16,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:16,997 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:16,998 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,002 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:13:17,002 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379 2023-07-13 23:13:17,003 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,003 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,003 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,003 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 23:13:17,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 23:13:17,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 23:13:17,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 23:13:17,004 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/recovered.edits] 2023-07-13 23:13:17,005 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,005 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,005 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:17,005 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:17,005 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,005 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,005 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:17,005 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:17,006 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/recovered.edits] 2023-07-13 23:13:17,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-13 23:13:17,014 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/cf/af2640d30a1b44b2a41464deb87b754d to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/cf/af2640d30a1b44b2a41464deb87b754d 2023-07-13 23:13:17,016 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/cf/1d2ccddfd7ee44c5bed5b687679bfd4b to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/cf/1d2ccddfd7ee44c5bed5b687679bfd4b 2023-07-13 23:13:17,021 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379/recovered.edits/9.seqid 2023-07-13 23:13:17,022 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83f91c43255e06b504043c7623f63379 2023-07-13 23:13:17,022 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7/recovered.edits/9.seqid 2023-07-13 23:13:17,023 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e9d40cfbda45e3af11e5bbcf6ded70f7 2023-07-13 23:13:17,023 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-13 23:13:17,023 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-13 23:13:17,027 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-13 23:13:17,032 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230713bcd4edead0bb45e0adbc9afb5d6008a8 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230713bcd4edead0bb45e0adbc9afb5d6008a8 2023-07-13 23:13:17,034 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713caf3e84e32d944f5b5c1b833191c8723 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713caf3e84e32d944f5b5c1b833191c8723 2023-07-13 23:13:17,035 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-13 23:13:17,038 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,044 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-13 23:13:17,048 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-13 23:13:17,049 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,049 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-13 23:13:17,050 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289997050"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:17,050 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289997050"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:17,052 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:13:17,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e9d40cfbda45e3af11e5bbcf6ded70f7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689289974141.e9d40cfbda45e3af11e5bbcf6ded70f7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 83f91c43255e06b504043c7623f63379, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289974141.83f91c43255e06b504043c7623f63379.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:13:17,052 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-13 23:13:17,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289997052"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:17,054 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-13 23:13:17,056 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 63 msec 2023-07-13 23:13:17,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-13 23:13:17,108 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-13 23:13:17,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-13 23:13:17,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-13 23:13:17,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:17,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-13 23:13:17,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:17,167 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 746) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:50198 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:54242 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1061173592) connection to jenkins-hbase4.apache.org/172.31.14.131:45017 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4106 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:38244 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1932186206_1 at /127.0.0.1:54214 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1932186206_1 at /127.0.0.1:38228 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:38258 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=561 (was 430) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=3208 (was 3572) 2023-07-13 23:13:17,167 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-13 23:13:17,191 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=561, ProcessCount=183, AvailableMemoryMB=3207 2023-07-13 23:13:17,191 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-13 23:13:17,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 23:13:17,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:17,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:13:17,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-13 23:13:17,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:13:17,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:17,200 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:17,200 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:17,201 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796 empty. 2023-07-13 23:13:17,203 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0 empty. 2023-07-13 23:13:17,203 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:17,203 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:17,203 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-13 23:13:17,224 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-13 23:13:17,226 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0987c718e7e5cad8f13ca685d2782796, NAME => 'testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:13:17,226 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 87a47f977e5bce5c6dcc339539c8b8b0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:13:17,293 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:17,293 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0987c718e7e5cad8f13ca685d2782796, disabling compactions & flushes 2023-07-13 23:13:17,293 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:17,294 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:17,294 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. after waiting 0 ms 2023-07-13 23:13:17,294 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:17,294 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:17,294 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0987c718e7e5cad8f13ca685d2782796: 2023-07-13 23:13:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:17,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:17,698 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:17,698 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 87a47f977e5bce5c6dcc339539c8b8b0, disabling compactions & flushes 2023-07-13 23:13:17,698 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:17,698 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:17,698 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. after waiting 0 ms 2023-07-13 23:13:17,698 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:17,698 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:17,698 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 87a47f977e5bce5c6dcc339539c8b8b0: 2023-07-13 23:13:17,701 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:13:17,704 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289997704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289997704"}]},"ts":"1689289997704"} 2023-07-13 23:13:17,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289997704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289997704"}]},"ts":"1689289997704"} 2023-07-13 23:13:17,707 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:13:17,708 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:13:17,708 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289997708"}]},"ts":"1689289997708"} 2023-07-13 23:13:17,709 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-13 23:13:17,714 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:13:17,716 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:13:17,716 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:13:17,716 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:13:17,716 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:13:17,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0987c718e7e5cad8f13ca685d2782796, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87a47f977e5bce5c6dcc339539c8b8b0, ASSIGN}] 2023-07-13 23:13:17,724 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0987c718e7e5cad8f13ca685d2782796, ASSIGN 2023-07-13 23:13:17,725 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87a47f977e5bce5c6dcc339539c8b8b0, ASSIGN 2023-07-13 23:13:17,726 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87a47f977e5bce5c6dcc339539c8b8b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37295,1689289892196; forceNewPlan=false, retain=false 2023-07-13 23:13:17,726 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0987c718e7e5cad8f13ca685d2782796, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34053,1689289892354; forceNewPlan=false, retain=false 2023-07-13 23:13:17,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:17,876 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:13:17,880 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=87a47f977e5bce5c6dcc339539c8b8b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:17,880 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0987c718e7e5cad8f13ca685d2782796, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:17,880 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289997880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289997880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289997880"}]},"ts":"1689289997880"} 2023-07-13 23:13:17,880 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289997880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289997880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289997880"}]},"ts":"1689289997880"} 2023-07-13 23:13:17,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 87a47f977e5bce5c6dcc339539c8b8b0, server=jenkins-hbase4.apache.org,37295,1689289892196}] 2023-07-13 23:13:17,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 0987c718e7e5cad8f13ca685d2782796, server=jenkins-hbase4.apache.org,34053,1689289892354}] 2023-07-13 23:13:18,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:18,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87a47f977e5bce5c6dcc339539c8b8b0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:13:18,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. service=AccessControlService 2023-07-13 23:13:18,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:13:18,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:18,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:18,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:18,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:18,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:18,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0987c718e7e5cad8f13ca685d2782796, NAME => 'testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:13:18,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. service=AccessControlService 2023-07-13 23:13:18,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:13:18,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:18,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:18,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:18,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:18,047 INFO [StoreOpener-0987c718e7e5cad8f13ca685d2782796-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:18,047 INFO [StoreOpener-87a47f977e5bce5c6dcc339539c8b8b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:18,048 DEBUG [StoreOpener-87a47f977e5bce5c6dcc339539c8b8b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/cf 2023-07-13 23:13:18,048 DEBUG [StoreOpener-87a47f977e5bce5c6dcc339539c8b8b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/cf 2023-07-13 23:13:18,048 DEBUG [StoreOpener-0987c718e7e5cad8f13ca685d2782796-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/cf 2023-07-13 23:13:18,048 DEBUG [StoreOpener-0987c718e7e5cad8f13ca685d2782796-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/cf 2023-07-13 23:13:18,049 INFO [StoreOpener-87a47f977e5bce5c6dcc339539c8b8b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87a47f977e5bce5c6dcc339539c8b8b0 columnFamilyName cf 2023-07-13 23:13:18,049 INFO [StoreOpener-0987c718e7e5cad8f13ca685d2782796-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0987c718e7e5cad8f13ca685d2782796 columnFamilyName cf 2023-07-13 23:13:18,050 INFO [StoreOpener-87a47f977e5bce5c6dcc339539c8b8b0-1] regionserver.HStore(310): Store=87a47f977e5bce5c6dcc339539c8b8b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:13:18,051 INFO [StoreOpener-0987c718e7e5cad8f13ca685d2782796-1] regionserver.HStore(310): Store=0987c718e7e5cad8f13ca685d2782796/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:13:18,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:18,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:18,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:18,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:18,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:18,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:18,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:13:18,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87a47f977e5bce5c6dcc339539c8b8b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70516062, jitterRate=0.05077120661735535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:13:18,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:13:18,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87a47f977e5bce5c6dcc339539c8b8b0: 2023-07-13 23:13:18,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0987c718e7e5cad8f13ca685d2782796; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69792386, jitterRate=0.03998759388923645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:13:18,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0987c718e7e5cad8f13ca685d2782796: 2023-07-13 23:13:18,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0., pid=93, masterSystemTime=1689289998034 2023-07-13 23:13:18,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796., pid=94, masterSystemTime=1689289998035 2023-07-13 23:13:18,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:18,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:18,069 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=87a47f977e5bce5c6dcc339539c8b8b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,069 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289998069"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289998069"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289998069"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289998069"}]},"ts":"1689289998069"} 2023-07-13 23:13:18,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:18,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:18,070 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0987c718e7e5cad8f13ca685d2782796, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,070 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289998070"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289998070"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289998070"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289998070"}]},"ts":"1689289998070"} 2023-07-13 23:13:18,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-13 23:13:18,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 87a47f977e5bce5c6dcc339539c8b8b0, server=jenkins-hbase4.apache.org,37295,1689289892196 in 188 msec 2023-07-13 23:13:18,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-13 23:13:18,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87a47f977e5bce5c6dcc339539c8b8b0, ASSIGN in 357 msec 2023-07-13 23:13:18,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 0987c718e7e5cad8f13ca685d2782796, server=jenkins-hbase4.apache.org,34053,1689289892354 in 188 msec 2023-07-13 23:13:18,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-13 23:13:18,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0987c718e7e5cad8f13ca685d2782796, ASSIGN in 359 msec 2023-07-13 23:13:18,078 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:13:18,079 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289998079"}]},"ts":"1689289998079"} 2023-07-13 23:13:18,080 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-13 23:13:18,083 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:13:18,084 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-13 23:13:18,085 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:13:18,087 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:18,087 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:18,087 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:18,087 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:18,090 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:18,090 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:18,090 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:18,090 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:18,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 897 msec 2023-07-13 23:13:18,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:18,303 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-13 23:13:18,318 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:18,318 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:18,320 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:18,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:18,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289998378 (current time:1689289998378). 2023-07-13 23:13:18,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:13:18,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x16a64b27 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:18,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a0bbc3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:18,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:18,432 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:18,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16a64b27 to 127.0.0.1:63739 2023-07-13 23:13:18,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:18,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x5016e7ef to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:18,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@744d61b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:18,487 DEBUG [hconnection-0x76b1a250-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:18,492 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:18,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:18,503 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:18,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5016e7ef to 127.0.0.1:63739 2023-07-13 23:13:18,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:18,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:13:18,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:13:18,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:18,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:18,518 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:18,527 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689290598527 2023-07-13 23:13:18,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:18,528 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:18,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:18,532 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:18,532 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:13:18,533 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:13:18,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 19 msec 2023-07-13 23:13:18,539 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:18,542 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689290598542 2023-07-13 23:13:18,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,595 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-13 23:13:18,595 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:18,596 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-13 23:13:18,596 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-13 23:13:18,613 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,613 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:18,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:18,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:18,622 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:18,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,622 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,624 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,624 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:18,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:18,625 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,625 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:13:18,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,627 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:18,627 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:18,630 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,633 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:18,636 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:18,636 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:18,633 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:18,637 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:18,638 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:18,638 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:18,636 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:18,638 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:18,636 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:18,641 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:18,641 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:18,641 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:18,641 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,642 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:18,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:18,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:18,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:18,647 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,647 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,647 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,647 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,647 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:18,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:18,647 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,647 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:18,647 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,648 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:18,647 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:13:18,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:18,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:18,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 23:13:18,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27743b30[Count = 1] remaining members to acquire global barrier 2023-07-13 23:13:18,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:18,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:18,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:18,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:18,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:18,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 23:13:18,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27743b30[Count = 0] remaining members to acquire global barrier 2023-07-13 23:13:18,657 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 23:13:18,657 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,658 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,658 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:18,658 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:18,658 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:13:18,659 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,659 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:18,659 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,659 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,659 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:18,659 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:18,659 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:18,659 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:18,659 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. started... 2023-07-13 23:13:18,660 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0987c718e7e5cad8f13ca685d2782796: 2023-07-13 23:13:18,660 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,660 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:18,660 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:13:18,660 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:18,660 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:18,660 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:18,661 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. started... 2023-07-13 23:13:18,661 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:18,661 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:18,661 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:18,661 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,663 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87a47f977e5bce5c6dcc339539c8b8b0: 2023-07-13 23:13:18,663 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:13:18,663 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,663 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:18,663 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:13:18,703 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. completed. 2023-07-13 23:13:18,703 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:18,703 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:18,703 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,706 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:18,707 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:13:18,709 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,709 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:18,709 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:18,709 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:18,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:18,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:18,709 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. completed. 2023-07-13 23:13:18,711 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:18,711 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:18,712 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:18,712 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,712 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:18,712 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:13:18,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:18,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:18,713 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,713 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:18,713 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:18,713 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:18,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37295,1689289892196': 2023-07-13 23:13:18,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 23:13:18,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:18,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:18,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:18,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:18,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:18,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34053,1689289892354': 2023-07-13 23:13:18,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 23:13:18,725 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-13 23:13:18,725 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:13:18,725 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:13:18,725 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,725 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:13:18,727 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,727 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,727 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,727 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:18,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,727 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,727 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:18,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:18,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:18,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,727 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:18,728 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:18,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:18,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:18,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:18,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:18,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:18,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:18,729 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:18,730 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,733 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:18,734 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,734 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,742 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:18,742 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:18,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:18,742 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:18,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:18,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:18,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:18,742 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:18,742 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:18,742 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:18,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:18,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:18,743 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,743 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,743 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,743 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,743 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,743 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:18,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:18,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:18,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:18,743 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:18,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:13:18,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:18,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:18,743 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,745 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:18,745 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:18,746 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,746 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:18,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:18,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 23:13:18,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,848 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:18,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:18,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:18,850 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:13:18,904 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-13 23:13:18,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,905 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:18,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689289998528Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689289998761 (+233 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689289998761Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689289998761Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689289998767 (+6 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689289998792 (+25 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689289998904 (+112 ms) 2023-07-13 23:13:18,911 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:18,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 382 msec 2023-07-13 23:13:19,150 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:19,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:19,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:13:19,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34053] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:13:19,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37295] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:13:19,168 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:19,168 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:19,169 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:19,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:19,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289999185 (current time:1689289999185). 2023-07-13 23:13:19,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:13:19,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x2de86cf9 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:19,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56b0f836, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:19,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:19,214 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:19,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2de86cf9 to 127.0.0.1:63739 2023-07-13 23:13:19,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:19,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x448a87be to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:19,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2aebb472, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:19,327 DEBUG [hconnection-0x7b4b8851-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:19,328 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:19,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:19,335 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:19,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x448a87be to 127.0.0.1:63739 2023-07-13 23:13:19,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:19,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:13:19,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:13:19,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:19,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:19,344 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:19,345 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689290599345 2023-07-13 23:13:19,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:19,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:19,347 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:13:19,347 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:13:19,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:19,351 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:19,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-13 23:13:19,354 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:19,354 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689290599354 2023-07-13 23:13:19,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,371 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-13 23:13:19,372 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:19,373 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-13 23:13:19,373 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-13 23:13:19,374 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,374 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,375 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:19,375 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:19,375 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:19,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:19,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:19,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:19,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:19,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:19,375 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,376 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,376 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,378 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 23:13:19,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,378 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:13:19,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:19,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 23:13:19,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:19,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:19,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 23:13:19,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:19,379 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:19,381 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:19,381 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:19,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,381 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:19,381 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:19,381 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:19,383 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:19,383 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:19,387 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:19,389 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,391 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,391 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:19,392 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,392 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:19,392 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:19,393 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,393 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:19,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 23:13:19,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5d0fd3[Count = 1] remaining members to acquire global barrier 2023-07-13 23:13:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:19,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 23:13:19,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5d0fd3[Count = 0] remaining members to acquire global barrier 2023-07-13 23:13:19,400 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 23:13:19,400 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,405 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,405 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,405 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:19,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,406 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:13:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:19,406 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,406 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:13:19,406 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:19,406 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. started... 2023-07-13 23:13:19,407 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0987c718e7e5cad8f13ca685d2782796 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-13 23:13:19,408 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:19,408 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:19,408 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:19,410 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:19,412 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:19,412 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:19,412 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. started... 2023-07-13 23:13:19,413 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87a47f977e5bce5c6dcc339539c8b8b0 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-13 23:13:19,447 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:19,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:19,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:19,448 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:13:19,473 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230713fb12a962e2d847d2904876251eda728b to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230713fb12a962e2d847d2904876251eda728b 2023-07-13 23:13:19,473 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071315a2003861824b3caafca4bc41af3c2a to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071315a2003861824b3caafca4bc41af3c2a 2023-07-13 23:13:19,484 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/.tmp/cf/d485abc18c8b470e8cd6c27e2af8f24b 2023-07-13 23:13:19,485 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/.tmp/cf/3930199f6fdf43a59f3ab7452a753e0b 2023-07-13 23:13:19,494 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/.tmp/cf/3930199f6fdf43a59f3ab7452a753e0b as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/cf/3930199f6fdf43a59f3ab7452a753e0b 2023-07-13 23:13:19,494 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/.tmp/cf/d485abc18c8b470e8cd6c27e2af8f24b as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/cf/d485abc18c8b470e8cd6c27e2af8f24b 2023-07-13 23:13:19,500 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/cf/3930199f6fdf43a59f3ab7452a753e0b, entries=4, sequenceid=6, filesize=5.6 K 2023-07-13 23:13:19,501 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 0987c718e7e5cad8f13ca685d2782796 in 94ms, sequenceid=6, compaction requested=false 2023-07-13 23:13:19,501 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-13 23:13:19,502 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0987c718e7e5cad8f13ca685d2782796: 2023-07-13 23:13:19,502 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,502 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:19,502 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/cf/3930199f6fdf43a59f3ab7452a753e0b] hfiles 2023-07-13 23:13:19,502 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/cf/3930199f6fdf43a59f3ab7452a753e0b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,504 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/cf/d485abc18c8b470e8cd6c27e2af8f24b, entries=46, sequenceid=6, filesize=12.9 K 2023-07-13 23:13:19,505 INFO [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 87a47f977e5bce5c6dcc339539c8b8b0 in 91ms, sequenceid=6, compaction requested=false 2023-07-13 23:13:19,512 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87a47f977e5bce5c6dcc339539c8b8b0: 2023-07-13 23:13:19,512 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,512 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:19,512 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/cf/d485abc18c8b470e8cd6c27e2af8f24b] hfiles 2023-07-13 23:13:19,512 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/cf/d485abc18c8b470e8cd6c27e2af8f24b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,522 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. completed. 2023-07-13 23:13:19,522 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:19,522 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:19,522 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:19,522 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,522 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:19,522 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:13:19,524 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:19,525 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. completed. 2023-07-13 23:13:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:19,525 DEBUG [rs(jenkins-hbase4.apache.org,37295,1689289892196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:13:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:19,529 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:19,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34053,1689289892354': 2023-07-13 23:13:19,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 23:13:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37295,1689289892196': 2023-07-13 23:13:19,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 23:13:19,539 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-13 23:13:19,539 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:13:19,539 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:13:19,539 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,539 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:13:19,542 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:19,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:19,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:19,542 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,542 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:19,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:19,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:19,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:19,543 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,543 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,547 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:19,547 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,547 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,551 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,551 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,551 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,551 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,551 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:19,551 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:19,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:19,551 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:19,551 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:19,551 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:19,551 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,553 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:19,553 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:19,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:19,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:19,553 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:19,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:19,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:19,553 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,553 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:19,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:19,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:13:19,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:19,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:19,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:19,553 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:19,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:19,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:19,554 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,554 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230713fb12a962e2d847d2904876251eda728b, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071315a2003861824b3caafca4bc41af3c2a] mob files 2023-07-13 23:13:19,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230713fb12a962e2d847d2904876251eda728b 2023-07-13 23:13:19,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071315a2003861824b3caafca4bc41af3c2a 2023-07-13 23:13:19,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,649 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:19,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:19,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:19,651 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:13:19,793 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-13 23:13:19,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,794 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689289999345Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689289999570 (+225 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689289999570Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689289999571 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689289999576 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689289999608 (+32 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689289999793 (+185 ms) 2023-07-13 23:13:19,799 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:19,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 453 msec 2023-07-13 23:13:19,951 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:19,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:19,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:13:19,953 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953 2023-07-13 23:13:19,954 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33689, tgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953, rawTgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953, srcFsUri=hdfs://localhost:33689, srcDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:13:19,989 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:13:19,989 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_56980942_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:19,989 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29, snapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-13 23:13:20,004 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:20,085 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:20,085 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:20,086 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:20,086 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:21,238 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-7252401422273663221.jar 2023-07-13 23:13:21,239 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:21,239 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:21,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:21,330 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-5526389320717019352.jar 2023-07-13 23:13:21,331 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:21,332 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:21,332 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:21,333 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:21,333 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:21,334 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:21,334 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:13:21,335 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:13:21,335 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:13:21,336 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:13:21,336 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:13:21,337 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:13:21,338 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:13:21,338 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:13:21,339 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:13:21,340 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:13:21,340 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:21,341 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:21,342 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:21,342 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:21,342 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:21,343 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:21,344 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:22,075 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:13:22,404 WARN [Listener at jenkins-hbase4.apache.org/35127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:13:22,408 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-13 23:13:22,529 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:22,529 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:23,313 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0006_000001 (auth:SIMPLE) 2023-07-13 23:13:29,446 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0006_000001 (auth:SIMPLE) 2023-07-13 23:13:31,852 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:13:31,853 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:13:31,857 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:31,857 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:13:31,858 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:13:31,858 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:31,859 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-13 23:13:31,859 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-13 23:13:31,859 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:31,859 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-13 23:13:31,859 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689289999953/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-13 23:13:31,865 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-13 23:13:31,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-13 23:13:31,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:31,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 23:13:31,871 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290011871"}]},"ts":"1689290011871"} 2023-07-13 23:13:31,872 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-13 23:13:31,874 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-13 23:13:31,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0987c718e7e5cad8f13ca685d2782796, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87a47f977e5bce5c6dcc339539c8b8b0, UNASSIGN}] 2023-07-13 23:13:31,880 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0987c718e7e5cad8f13ca685d2782796, UNASSIGN 2023-07-13 23:13:31,880 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87a47f977e5bce5c6dcc339539c8b8b0, UNASSIGN 2023-07-13 23:13:31,881 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0987c718e7e5cad8f13ca685d2782796, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:31,881 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=87a47f977e5bce5c6dcc339539c8b8b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:31,881 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689290011881"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290011881"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290011881"}]},"ts":"1689290011881"} 2023-07-13 23:13:31,881 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689290011881"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290011881"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290011881"}]},"ts":"1689290011881"} 2023-07-13 23:13:31,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 0987c718e7e5cad8f13ca685d2782796, server=jenkins-hbase4.apache.org,34053,1689289892354}] 2023-07-13 23:13:31,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 87a47f977e5bce5c6dcc339539c8b8b0, server=jenkins-hbase4.apache.org,37295,1689289892196}] 2023-07-13 23:13:31,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 23:13:32,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:32,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0987c718e7e5cad8f13ca685d2782796, disabling compactions & flushes 2023-07-13 23:13:32,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:32,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:32,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. after waiting 0 ms 2023-07-13 23:13:32,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:32,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:32,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87a47f977e5bce5c6dcc339539c8b8b0, disabling compactions & flushes 2023-07-13 23:13:32,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:32,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:32,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. after waiting 0 ms 2023-07-13 23:13:32,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:32,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:32,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:32,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796. 2023-07-13 23:13:32,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0987c718e7e5cad8f13ca685d2782796: 2023-07-13 23:13:32,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:32,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:32,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:32,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0. 2023-07-13 23:13:32,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87a47f977e5bce5c6dcc339539c8b8b0: 2023-07-13 23:13:32,110 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0987c718e7e5cad8f13ca685d2782796, regionState=CLOSED 2023-07-13 23:13:32,110 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689290012110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290012110"}]},"ts":"1689290012110"} 2023-07-13 23:13:32,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:32,114 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=87a47f977e5bce5c6dcc339539c8b8b0, regionState=CLOSED 2023-07-13 23:13:32,114 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689290012114"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290012114"}]},"ts":"1689290012114"} 2023-07-13 23:13:32,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-13 23:13:32,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 0987c718e7e5cad8f13ca685d2782796, server=jenkins-hbase4.apache.org,34053,1689289892354 in 230 msec 2023-07-13 23:13:32,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0987c718e7e5cad8f13ca685d2782796, UNASSIGN in 240 msec 2023-07-13 23:13:32,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-13 23:13:32,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 87a47f977e5bce5c6dcc339539c8b8b0, server=jenkins-hbase4.apache.org,37295,1689289892196 in 231 msec 2023-07-13 23:13:32,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-13 23:13:32,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87a47f977e5bce5c6dcc339539c8b8b0, UNASSIGN in 243 msec 2023-07-13 23:13:32,120 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290012120"}]},"ts":"1689290012120"} 2023-07-13 23:13:32,121 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-13 23:13:32,127 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-13 23:13:32,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 263 msec 2023-07-13 23:13:32,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 23:13:32,173 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-13 23:13:32,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,178 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,179 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,183 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,185 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:32,185 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:32,187 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,187 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 23:13:32,188 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/recovered.edits] 2023-07-13 23:13:32,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 23:13:32,188 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 23:13:32,189 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,189 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 23:13:32,190 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/recovered.edits] 2023-07-13 23:13:32,191 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,191 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,191 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:32,191 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,191 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:32,191 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,191 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:32,191 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:32,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-13 23:13:32,201 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/cf/3930199f6fdf43a59f3ab7452a753e0b to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/cf/3930199f6fdf43a59f3ab7452a753e0b 2023-07-13 23:13:32,204 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/cf/d485abc18c8b470e8cd6c27e2af8f24b to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/cf/d485abc18c8b470e8cd6c27e2af8f24b 2023-07-13 23:13:32,206 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796/recovered.edits/9.seqid 2023-07-13 23:13:32,207 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/0987c718e7e5cad8f13ca685d2782796 2023-07-13 23:13:32,208 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0/recovered.edits/9.seqid 2023-07-13 23:13:32,208 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testEmptyExportFileSystemState/87a47f977e5bce5c6dcc339539c8b8b0 2023-07-13 23:13:32,208 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-13 23:13:32,209 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-13 23:13:32,210 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-13 23:13:32,213 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230713fb12a962e2d847d2904876251eda728b to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230713fb12a962e2d847d2904876251eda728b 2023-07-13 23:13:32,215 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071315a2003861824b3caafca4bc41af3c2a to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071315a2003861824b3caafca4bc41af3c2a 2023-07-13 23:13:32,215 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-13 23:13:32,218 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,221 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-13 23:13:32,223 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-13 23:13:32,224 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,225 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-13 23:13:32,225 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689290012225"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:32,225 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689290012225"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:32,227 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:13:32,227 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0987c718e7e5cad8f13ca685d2782796, NAME => 'testtb-testEmptyExportFileSystemState,,1689289997193.0987c718e7e5cad8f13ca685d2782796.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 87a47f977e5bce5c6dcc339539c8b8b0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689289997193.87a47f977e5bce5c6dcc339539c8b8b0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:13:32,227 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-13 23:13:32,227 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689290012227"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:32,237 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-13 23:13:32,239 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:32,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 65 msec 2023-07-13 23:13:32,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-13 23:13:32,302 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-13 23:13:32,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-13 23:13:32,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:32,321 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-13 23:13:32,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:32,367 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 758) Potentially hanging thread: IPC Client (1061173592) connection to jenkins-hbase4.apache.org/172.31.14.131:35127 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1061173592) connection to jenkins-hbase4.apache.org/172.31.14.131:36265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:46676 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-352150225_1 at /127.0.0.1:45408 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:41056 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4793 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1061173592) connection to jenkins-hbase4.apache.org/172.31.14.131:42521 from appattempt_1689289901608_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:45432 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=640 (was 561) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=3204 (was 3207) 2023-07-13 23:13:32,367 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-13 23:13:32,391 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=640, ProcessCount=183, AvailableMemoryMB=3203 2023-07-13 23:13:32,392 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-13 23:13:32,393 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 23:13:32,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,397 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:13:32,397 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-13 23:13:32,398 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:13:32,401 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:32,401 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:32,401 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd empty. 2023-07-13 23:13:32,401 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984 empty. 2023-07-13 23:13:32,402 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:32,402 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:32,402 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-13 23:13:32,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 23:13:32,421 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-13 23:13:32,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 08b3b9f46ef5c001b3770b95dbc33ecd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:13:32,431 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0e4e7b54c67ec90a9fedd0e0cf42d984, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 08b3b9f46ef5c001b3770b95dbc33ecd, disabling compactions & flushes 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 0e4e7b54c67ec90a9fedd0e0cf42d984, disabling compactions & flushes 2023-07-13 23:13:32,457 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:32,457 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. after waiting 0 ms 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. after waiting 0 ms 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:32,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:32,458 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:32,458 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:32,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 0e4e7b54c67ec90a9fedd0e0cf42d984: 2023-07-13 23:13:32,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 08b3b9f46ef5c001b3770b95dbc33ecd: 2023-07-13 23:13:32,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:13:32,464 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290012464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290012464"}]},"ts":"1689290012464"} 2023-07-13 23:13:32,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290012464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290012464"}]},"ts":"1689290012464"} 2023-07-13 23:13:32,467 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:13:32,468 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:13:32,468 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290012468"}]},"ts":"1689290012468"} 2023-07-13 23:13:32,470 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-13 23:13:32,473 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:13:32,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:13:32,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:13:32,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:13:32,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:13:32,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08b3b9f46ef5c001b3770b95dbc33ecd, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e4e7b54c67ec90a9fedd0e0cf42d984, ASSIGN}] 2023-07-13 23:13:32,477 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08b3b9f46ef5c001b3770b95dbc33ecd, ASSIGN 2023-07-13 23:13:32,477 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e4e7b54c67ec90a9fedd0e0cf42d984, ASSIGN 2023-07-13 23:13:32,478 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08b3b9f46ef5c001b3770b95dbc33ecd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34053,1689289892354; forceNewPlan=false, retain=false 2023-07-13 23:13:32,478 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e4e7b54c67ec90a9fedd0e0cf42d984, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43615,1689289892304; forceNewPlan=false, retain=false 2023-07-13 23:13:32,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 23:13:32,628 INFO [jenkins-hbase4:46453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:13:32,632 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0e4e7b54c67ec90a9fedd0e0cf42d984, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:32,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=08b3b9f46ef5c001b3770b95dbc33ecd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:32,632 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290012632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290012632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290012632"}]},"ts":"1689290012632"} 2023-07-13 23:13:32,632 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290012632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290012632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290012632"}]},"ts":"1689290012632"} 2023-07-13 23:13:32,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 08b3b9f46ef5c001b3770b95dbc33ecd, server=jenkins-hbase4.apache.org,34053,1689289892354}] 2023-07-13 23:13:32,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 0e4e7b54c67ec90a9fedd0e0cf42d984, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:13:32,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 23:13:32,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:32,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:32,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e4e7b54c67ec90a9fedd0e0cf42d984, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:13:32,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 08b3b9f46ef5c001b3770b95dbc33ecd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. service=AccessControlService 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. service=AccessControlService 2023-07-13 23:13:32,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:13:32,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:32,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:32,797 INFO [StoreOpener-0e4e7b54c67ec90a9fedd0e0cf42d984-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:32,799 INFO [StoreOpener-08b3b9f46ef5c001b3770b95dbc33ecd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:32,800 DEBUG [StoreOpener-08b3b9f46ef5c001b3770b95dbc33ecd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/cf 2023-07-13 23:13:32,800 DEBUG [StoreOpener-08b3b9f46ef5c001b3770b95dbc33ecd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/cf 2023-07-13 23:13:32,801 DEBUG [StoreOpener-0e4e7b54c67ec90a9fedd0e0cf42d984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/cf 2023-07-13 23:13:32,801 DEBUG [StoreOpener-0e4e7b54c67ec90a9fedd0e0cf42d984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/cf 2023-07-13 23:13:32,801 INFO [StoreOpener-08b3b9f46ef5c001b3770b95dbc33ecd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b3b9f46ef5c001b3770b95dbc33ecd columnFamilyName cf 2023-07-13 23:13:32,801 INFO [StoreOpener-0e4e7b54c67ec90a9fedd0e0cf42d984-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e4e7b54c67ec90a9fedd0e0cf42d984 columnFamilyName cf 2023-07-13 23:13:32,803 INFO [StoreOpener-0e4e7b54c67ec90a9fedd0e0cf42d984-1] regionserver.HStore(310): Store=0e4e7b54c67ec90a9fedd0e0cf42d984/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:13:32,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:32,804 INFO [StoreOpener-08b3b9f46ef5c001b3770b95dbc33ecd-1] regionserver.HStore(310): Store=08b3b9f46ef5c001b3770b95dbc33ecd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:13:32,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:32,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:32,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:32,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:32,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:32,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:13:32,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0e4e7b54c67ec90a9fedd0e0cf42d984; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61748269, jitterRate=-0.07987909018993378}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:13:32,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0e4e7b54c67ec90a9fedd0e0cf42d984: 2023-07-13 23:13:32,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984., pid=109, masterSystemTime=1689290012786 2023-07-13 23:13:32,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:13:32,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 08b3b9f46ef5c001b3770b95dbc33ecd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71731406, jitterRate=0.06888124346733093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:13:32,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 08b3b9f46ef5c001b3770b95dbc33ecd: 2023-07-13 23:13:32,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:32,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:32,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd., pid=108, masterSystemTime=1689290012789 2023-07-13 23:13:32,823 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0e4e7b54c67ec90a9fedd0e0cf42d984, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:32,823 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290012823"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689290012823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689290012823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689290012823"}]},"ts":"1689290012823"} 2023-07-13 23:13:32,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:32,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:32,824 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=08b3b9f46ef5c001b3770b95dbc33ecd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:32,824 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290012824"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689290012824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689290012824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689290012824"}]},"ts":"1689290012824"} 2023-07-13 23:13:32,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-13 23:13:32,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 0e4e7b54c67ec90a9fedd0e0cf42d984, server=jenkins-hbase4.apache.org,43615,1689289892304 in 198 msec 2023-07-13 23:13:32,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-13 23:13:32,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 08b3b9f46ef5c001b3770b95dbc33ecd, server=jenkins-hbase4.apache.org,34053,1689289892354 in 198 msec 2023-07-13 23:13:32,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e4e7b54c67ec90a9fedd0e0cf42d984, ASSIGN in 359 msec 2023-07-13 23:13:32,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-13 23:13:32,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08b3b9f46ef5c001b3770b95dbc33ecd, ASSIGN in 360 msec 2023-07-13 23:13:32,840 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:13:32,840 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290012840"}]},"ts":"1689290012840"} 2023-07-13 23:13:32,841 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-13 23:13:32,844 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:13:32,844 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-13 23:13:32,846 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 23:13:32,847 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:32,847 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:32,847 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:32,847 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:32,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:32,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:32,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:32,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:32,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 459 msec 2023-07-13 23:13:33,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 23:13:33,011 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-13 23:13:33,016 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,017 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:33,019 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:33,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:33,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689290013053 (current time:1689290013053). 2023-07-13 23:13:33,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:13:33,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x53060d0e to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:33,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d4f125a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:33,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:33,067 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:33,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53060d0e to 127.0.0.1:63739 2023-07-13 23:13:33,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:33,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x1c569712 to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:33,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fdb97eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:33,176 DEBUG [hconnection-0x4ab38788-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:33,180 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:33,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:33,187 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:33,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c569712 to 127.0.0.1:63739 2023-07-13 23:13:33,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:33,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 23:13:33,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:13:33,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:33,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:33,192 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:33,193 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689290613193 2023-07-13 23:13:33,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:33,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,194 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:13:33,194 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:13:33,196 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:33,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:33,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-13 23:13:33,198 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:33,198 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689290613198 2023-07-13 23:13:33,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,217 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-13 23:13:33,218 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:33,220 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-13 23:13:33,220 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-13 23:13:33,220 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,220 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,222 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:33,222 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:33,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:33,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:33,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:33,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:33,222 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:33,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:33,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:33,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,222 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,224 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,224 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 23:13:33,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,224 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,224 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:13:33,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:33,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 23:13:33,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 23:13:33,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:33,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:33,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,231 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:33,231 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:33,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,233 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:33,234 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:33,234 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:33,234 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:33,234 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:33,236 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:33,237 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:33,237 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:33,243 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,243 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:33,244 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,244 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:33,244 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,244 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,244 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,244 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:33,244 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:33,245 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,245 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:33,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 23:13:33,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56ced365[Count = 1] remaining members to acquire global barrier 2023-07-13 23:13:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:33,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 23:13:33,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56ced365[Count = 0] remaining members to acquire global barrier 2023-07-13 23:13:33,249 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-13 23:13:33,249 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,251 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,251 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:33,251 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:33,251 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:33,251 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:13:33,252 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:33,252 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,252 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:13:33,253 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:33,253 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:33,253 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:33,254 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:33,263 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:33,263 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:33,262 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:33,263 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:33,263 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. started... 2023-07-13 23:13:33,266 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:33,266 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e4e7b54c67ec90a9fedd0e0cf42d984: 2023-07-13 23:13:33,266 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. started... 2023-07-13 23:13:33,266 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,266 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08b3b9f46ef5c001b3770b95dbc33ecd: 2023-07-13 23:13:33,266 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:33,266 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:13:33,266 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,266 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:33,267 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:13:33,303 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:33,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:33,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:33,304 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:13:33,315 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. completed. 2023-07-13 23:13:33,315 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:33,315 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:33,315 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:33,315 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,315 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:33,315 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:13:33,317 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. completed. 2023-07-13 23:13:33,317 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:33,317 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:33,317 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:33,317 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,317 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:33,317 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:13:33,317 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,317 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:33,321 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,321 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:33,321 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:33,321 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:33,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:33,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:13:33,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-13 23:13:33,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:33,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:33,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:33,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:33,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:33,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34053,1689289892354': 2023-07-13 23:13:33,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-13 23:13:33,330 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-13 23:13:33,330 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:13:33,330 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:13:33,330 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,330 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:13:33,332 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:33,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:33,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:33,333 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,333 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,332 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:33,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,332 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:33,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:33,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:33,334 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,336 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,337 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,337 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,341 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:33,341 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:33,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:33,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:33,341 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:33,341 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,341 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,342 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,342 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,342 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,342 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:33,342 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:33,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:33,342 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,344 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:33,341 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:33,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:33,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:33,344 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:33,344 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:33,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-13 23:13:33,342 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:13:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:33,345 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:33,345 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:33,345 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,345 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:33,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:33,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:33,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:33,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 23:13:33,510 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:33,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:33,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:33,514 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:13:33,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,817 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:33,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:33,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:33,819 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-13 23:13:33,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-13 23:13:33,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,971 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:33,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689290013193Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689290013760 (+567 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689290013760Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689290013760Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689290013775 (+15 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689290013826 (+51 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689290013970 (+144 ms) 2023-07-13 23:13:33,974 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:33,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 780 msec 2023-07-13 23:13:34,320 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:34,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:34,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:13:34,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34053] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:13:34,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:13:34,329 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,329 DEBUG [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:34,329 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:34,340 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:34,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689290014340 (current time:1689290014340). 2023-07-13 23:13:34,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:13:34,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x3bdfc7ca to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:34,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d0698fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:34,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:34,351 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:34,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bdfc7ca to 127.0.0.1:63739 2023-07-13 23:13:34,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:34,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] zookeeper.ReadOnlyZKClient(139): Connect 0x72a7a1ec to 127.0.0.1:63739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:34,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3703c9e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:34,389 DEBUG [hconnection-0x6e1b7693-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:34,393 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:34,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:34,405 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:34,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72a7a1ec to 127.0.0.1:63739 2023-07-13 23:13:34,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:34,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 23:13:34,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:13:34,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:34,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:34,412 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:34,413 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689290614413 2023-07-13 23:13:34,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:34,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,413 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:13:34,413 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:13:34,416 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:34,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:34,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-13 23:13:34,432 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:34,432 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689290614432 2023-07-13 23:13:34,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,449 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-13 23:13:34,449 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:34,451 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-13 23:13:34,451 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-13 23:13:34,451 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,451 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,453 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:34,453 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:34,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:34,453 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:34,453 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:34,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:34,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:34,453 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:34,454 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,455 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,455 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:13:34,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 23:13:34,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 23:13:34,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 23:13:34,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,455 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:34,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:34,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:34,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,456 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:34,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,458 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:34,458 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:34,459 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:34,458 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:34,458 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:34,463 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:34,465 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:34,465 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:34,460 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:34,465 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:34,465 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:34,465 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:34,465 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:34,465 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37295,1689289892196' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:34,480 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,480 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:34,515 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:34,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:34,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:34,516 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:13:34,519 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:34,519 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,519 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,519 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:34,519 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,520 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:34,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:34,519 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,521 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,521 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:34,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43615,1689289892304' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 23:13:34,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fc37968[Count = 1] remaining members to acquire global barrier 2023-07-13 23:13:34,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:34,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:34,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:34,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:34,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:34,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:34,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34053,1689289892354' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 23:13:34,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fc37968[Count = 0] remaining members to acquire global barrier 2023-07-13 23:13:34,530 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-13 23:13:34,530 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,665 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,665 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,665 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:34,666 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:34,667 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37295,1689289892196' in zk 2023-07-13 23:13:34,667 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:34,667 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:34,667 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:13:34,667 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:34,667 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. started... 2023-07-13 23:13:34,667 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:34,667 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. started... 2023-07-13 23:13:34,667 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:34,667 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 08b3b9f46ef5c001b3770b95dbc33ecd 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-13 23:13:34,668 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0e4e7b54c67ec90a9fedd0e0cf42d984 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-13 23:13:34,716 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:34,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:34,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:34,718 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:13:34,726 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:34,726 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:34,726 DEBUG [member: 'jenkins-hbase4.apache.org,37295,1689289892196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:34,782 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071300cfbecc646a4334a9b5a27e85293346 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071300cfbecc646a4334a9b5a27e85293346 2023-07-13 23:13:34,784 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230713f07447a88d344efdace128d72b31cec9 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230713f07447a88d344efdace128d72b31cec9 2023-07-13 23:13:34,810 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/.tmp/cf/567a95d581ae46f8a02678f5e2165266 2023-07-13 23:13:34,816 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/.tmp/cf/567a95d581ae46f8a02678f5e2165266 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/cf/567a95d581ae46f8a02678f5e2165266 2023-07-13 23:13:34,821 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/cf/567a95d581ae46f8a02678f5e2165266, entries=46, sequenceid=6, filesize=13.2 K 2023-07-13 23:13:34,859 INFO [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 0e4e7b54c67ec90a9fedd0e0cf42d984 in 192ms, sequenceid=6, compaction requested=false 2023-07-13 23:13:34,859 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-13 23:13:34,859 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e4e7b54c67ec90a9fedd0e0cf42d984: 2023-07-13 23:13:34,860 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,860 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:34,860 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/cf/567a95d581ae46f8a02678f5e2165266] hfiles 2023-07-13 23:13:34,860 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/cf/567a95d581ae46f8a02678f5e2165266 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,862 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/.tmp/cf/d8fdb7efaddf48b28cf02092552b78e0 2023-07-13 23:13:34,870 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/.tmp/cf/d8fdb7efaddf48b28cf02092552b78e0 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/cf/d8fdb7efaddf48b28cf02092552b78e0 2023-07-13 23:13:34,878 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. completed. 2023-07-13 23:13:34,879 DEBUG [rs(jenkins-hbase4.apache.org,43615,1689289892304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:34,879 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43615,1689289892304' in zk 2023-07-13 23:13:34,882 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/cf/d8fdb7efaddf48b28cf02092552b78e0, entries=4, sequenceid=6, filesize=5.6 K 2023-07-13 23:13:34,887 INFO [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 08b3b9f46ef5c001b3770b95dbc33ecd in 220ms, sequenceid=6, compaction requested=false 2023-07-13 23:13:34,895 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08b3b9f46ef5c001b3770b95dbc33ecd: 2023-07-13 23:13:34,895 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,895 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:34,895 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/cf/d8fdb7efaddf48b28cf02092552b78e0] hfiles 2023-07-13 23:13:34,895 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/cf/d8fdb7efaddf48b28cf02092552b78e0 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,926 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:34,926 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,926 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:34,927 DEBUG [member: 'jenkins-hbase4.apache.org,43615,1689289892304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:34,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:34,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43615,1689289892304': 2023-07-13 23:13:34,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43615,1689289892304' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-13 23:13:34,977 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. completed. 2023-07-13 23:13:34,977 DEBUG [rs(jenkins-hbase4.apache.org,34053,1689289892354)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:34,978 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:34,978 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:34,978 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34053,1689289892354' in zk 2023-07-13 23:13:35,003 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:35,003 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:35,003 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,004 DEBUG [member: 'jenkins-hbase4.apache.org,34053,1689289892354' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:35,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:35,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:35,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:35,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:35,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:35,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:35,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:35,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:35,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:35,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34053,1689289892354': 2023-07-13 23:13:35,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34053,1689289892354' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-13 23:13:35,011 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-13 23:13:35,011 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:13:35,012 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:13:35,012 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,012 INFO [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:13:35,018 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:35,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:35,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:35,019 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-13 23:13:35,042 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:35,042 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:35,042 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,042 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,043 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:35,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:35,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:35,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:35,044 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:35,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:35,044 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:35,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:35,047 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,048 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,048 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:35,126 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:35,127 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:35,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:35,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:35,127 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,127 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:35,127 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,127 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,127 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:13:35,127 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,128 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:35,128 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:35,128 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:35,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:35,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:35,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,128 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:35,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,128 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:35,128 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:35,128 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,128 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,128 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:35,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:35,128 DEBUG [(jenkins-hbase4.apache.org,46453,1689289890678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:35,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:35,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:35,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:35,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 23:13:35,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:35,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:35,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230713f07447a88d344efdace128d72b31cec9, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071300cfbecc646a4334a9b5a27e85293346] mob files 2023-07-13 23:13:35,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230713f07447a88d344efdace128d72b31cec9 2023-07-13 23:13:35,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071300cfbecc646a4334a9b5a27e85293346 2023-07-13 23:13:35,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-13 23:13:35,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,294 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689290014413Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689290015142 (+729 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689290015142Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689290015142Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689290015150 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689290015179 (+29 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689290015293 (+114 ms) 2023-07-13 23:13:35,297 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:35,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 882 msec 2023-07-13 23:13:35,519 DEBUG [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:35,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:35,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:13:35,521 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521 2023-07-13 23:13:35,521 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33689, tgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521, rawTgtDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521, srcFsUri=hdfs://localhost:33689, srcDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:13:35,546 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29 2023-07-13 23:13:35,546 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_185956361_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,546 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33689, inputRoot=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29, snapshotDir=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-13 23:13:35,555 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:35,619 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:35,620 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:35,620 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:35,620 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:36,636 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-4782870038981924194.jar 2023-07-13 23:13:36,637 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:36,637 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:36,719 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/hadoop-8417885774486653457.jar 2023-07-13 23:13:36,719 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:36,720 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:36,720 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:36,721 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:36,721 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:36,721 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:36,722 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:13:36,722 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:13:36,723 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:13:36,723 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:13:36,723 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:13:36,724 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:13:36,725 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:13:36,725 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:13:36,725 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:13:36,726 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:13:36,727 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:36,728 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:36,728 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:36,729 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:36,729 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:36,730 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:36,730 DEBUG [Listener at jenkins-hbase4.apache.org/35127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:37,035 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0006_000001 (auth:SIMPLE) 2023-07-13 23:13:37,706 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:13:38,375 WARN [Listener at jenkins-hbase4.apache.org/35127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:13:38,381 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-13 23:13:38,386 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-13 23:13:38,549 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:38,549 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:39,056 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0007_000001 (auth:SIMPLE) 2023-07-13 23:13:44,884 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0007_000001 (auth:SIMPLE) 2023-07-13 23:13:47,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0007_000001 (auth:SIMPLE) 2023-07-13 23:13:50,883 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901608_0007_000001 (auth:SIMPLE) 2023-07-13 23:13:52,911 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:13:52,911 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:13:52,928 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:52,928 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:13:52,929 INFO [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:13:52,929 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:52,930 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-13 23:13:52,930 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-13 23:13:52,930 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360223080_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:52,930 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-13 23:13:52,931 DEBUG [Listener at jenkins-hbase4.apache.org/35127] snapshot.TestExportSnapshot(367): hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/export-test/export-1689290015521/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-13 23:13:52,937 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:52,937 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:52,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:52,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 23:13:52,941 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290032941"}]},"ts":"1689290032941"} 2023-07-13 23:13:52,942 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-13 23:13:52,944 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-13 23:13:52,945 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08b3b9f46ef5c001b3770b95dbc33ecd, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e4e7b54c67ec90a9fedd0e0cf42d984, UNASSIGN}] 2023-07-13 23:13:52,947 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08b3b9f46ef5c001b3770b95dbc33ecd, UNASSIGN 2023-07-13 23:13:52,947 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e4e7b54c67ec90a9fedd0e0cf42d984, UNASSIGN 2023-07-13 23:13:52,948 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=08b3b9f46ef5c001b3770b95dbc33ecd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:13:52,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0e4e7b54c67ec90a9fedd0e0cf42d984, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:13:52,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290032948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290032948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290032948"}]},"ts":"1689290032948"} 2023-07-13 23:13:52,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290032948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290032948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290032948"}]},"ts":"1689290032948"} 2023-07-13 23:13:52,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 08b3b9f46ef5c001b3770b95dbc33ecd, server=jenkins-hbase4.apache.org,34053,1689289892354}] 2023-07-13 23:13:52,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 0e4e7b54c67ec90a9fedd0e0cf42d984, server=jenkins-hbase4.apache.org,43615,1689289892304}] 2023-07-13 23:13:53,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 23:13:53,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:53,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:53,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0e4e7b54c67ec90a9fedd0e0cf42d984, disabling compactions & flushes 2023-07-13 23:13:53,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 08b3b9f46ef5c001b3770b95dbc33ecd, disabling compactions & flushes 2023-07-13 23:13:53,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:53,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:53,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:53,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:53,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. after waiting 0 ms 2023-07-13 23:13:53,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. after waiting 0 ms 2023-07-13 23:13:53,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:53,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:53,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:53,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:53,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:53,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:53,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd. 2023-07-13 23:13:53,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984. 2023-07-13 23:13:53,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 08b3b9f46ef5c001b3770b95dbc33ecd: 2023-07-13 23:13:53,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0e4e7b54c67ec90a9fedd0e0cf42d984: 2023-07-13 23:13:53,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:53,123 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=08b3b9f46ef5c001b3770b95dbc33ecd, regionState=CLOSED 2023-07-13 23:13:53,123 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290033123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290033123"}]},"ts":"1689290033123"} 2023-07-13 23:13:53,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:53,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0e4e7b54c67ec90a9fedd0e0cf42d984, regionState=CLOSED 2023-07-13 23:13:53,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290033125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290033125"}]},"ts":"1689290033125"} 2023-07-13 23:13:53,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-13 23:13:53,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 08b3b9f46ef5c001b3770b95dbc33ecd, server=jenkins-hbase4.apache.org,34053,1689289892354 in 176 msec 2023-07-13 23:13:53,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08b3b9f46ef5c001b3770b95dbc33ecd, UNASSIGN in 182 msec 2023-07-13 23:13:53,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-13 23:13:53,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 0e4e7b54c67ec90a9fedd0e0cf42d984, server=jenkins-hbase4.apache.org,43615,1689289892304 in 177 msec 2023-07-13 23:13:53,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-13 23:13:53,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e4e7b54c67ec90a9fedd0e0cf42d984, UNASSIGN in 184 msec 2023-07-13 23:13:53,131 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290033131"}]},"ts":"1689290033131"} 2023-07-13 23:13:53,132 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-13 23:13:53,133 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-13 23:13:53,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 197 msec 2023-07-13 23:13:53,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 23:13:53,244 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-13 23:13:53,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,248 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,254 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,254 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37295] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,258 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,258 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,258 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,258 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 23:13:53,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 23:13:53,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 23:13:53,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 23:13:53,259 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:53,260 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,260 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:53,260 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,260 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,260 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:53,260 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:53,260 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,260 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:53,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 23:13:53,267 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:53,267 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/recovered.edits] 2023-07-13 23:13:53,269 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/cf, FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/recovered.edits] 2023-07-13 23:13:53,315 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/cf/d8fdb7efaddf48b28cf02092552b78e0 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/cf/d8fdb7efaddf48b28cf02092552b78e0 2023-07-13 23:13:53,319 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/cf/567a95d581ae46f8a02678f5e2165266 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/cf/567a95d581ae46f8a02678f5e2165266 2023-07-13 23:13:53,323 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd/recovered.edits/9.seqid 2023-07-13 23:13:53,323 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08b3b9f46ef5c001b3770b95dbc33ecd 2023-07-13 23:13:53,324 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/recovered.edits/9.seqid to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984/recovered.edits/9.seqid 2023-07-13 23:13:53,325 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e4e7b54c67ec90a9fedd0e0cf42d984 2023-07-13 23:13:53,325 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-13 23:13:53,326 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-13 23:13:53,327 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-13 23:13:53,331 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230713f07447a88d344efdace128d72b31cec9 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230713f07447a88d344efdace128d72b31cec9 2023-07-13 23:13:53,333 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071300cfbecc646a4334a9b5a27e85293346 to hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071300cfbecc646a4334a9b5a27e85293346 2023-07-13 23:13:53,334 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-13 23:13:53,336 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,342 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-13 23:13:53,345 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-13 23:13:53,346 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,347 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-13 23:13:53,347 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689290033347"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:53,347 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689290033347"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:53,352 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:13:53,353 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 08b3b9f46ef5c001b3770b95dbc33ecd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689290012393.08b3b9f46ef5c001b3770b95dbc33ecd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0e4e7b54c67ec90a9fedd0e0cf42d984, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290012393.0e4e7b54c67ec90a9fedd0e0cf42d984.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:13:53,353 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-13 23:13:53,353 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689290033353"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:53,356 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-13 23:13:53,358 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 113 msec 2023-07-13 23:13:53,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 23:13:53,363 INFO [Listener at jenkins-hbase4.apache.org/35127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-13 23:13:53,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-13 23:13:53,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,374 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-13 23:13:53,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:53,409 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:48316 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:57470 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1061173592) connection to jenkins-hbase4.apache.org/172.31.14.131:37425 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5435 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95794598_1 at /127.0.0.1:48292 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-360223080_17 at /127.0.0.1:58912 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51c336ea-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=897 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=574 (was 640), ProcessCount=183 (was 183), AvailableMemoryMB=2325 (was 3203) 2023-07-13 23:13:53,409 WARN [Listener at jenkins-hbase4.apache.org/35127] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-13 23:13:53,409 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-13 23:13:53,427 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-13 23:13:53,538 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689289901608_0007_01_000001 is : 143 2023-07-13 23:13:58,713 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:14:07,561 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-13 23:14:21,682 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 23:14:21,683 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-13 23:14:21,793 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-13 23:14:21,811 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-13 23:14:21,813 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 23:14:21,826 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-13 23:14:21,930 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 23:14:21,930 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-13 23:14:21,930 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-13 23:14:21,930 INFO [Listener at jenkins-hbase4.apache.org/35127] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-13 23:14:21,930 DEBUG [Listener at jenkins-hbase4.apache.org/35127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5577d993 to 127.0.0.1:63739 2023-07-13 23:14:21,930 DEBUG [Listener at jenkins-hbase4.apache.org/35127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:21,931 DEBUG [Listener at jenkins-hbase4.apache.org/35127] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-13 23:14:21,931 DEBUG [Listener at jenkins-hbase4.apache.org/35127] util.JVMClusterUtil(257): Found active master hash=1546380523, stopped=false 2023-07-13 23:14:21,931 DEBUG [Listener at jenkins-hbase4.apache.org/35127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:21,931 DEBUG [Listener at jenkins-hbase4.apache.org/35127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-13 23:14:21,931 INFO [Listener at jenkins-hbase4.apache.org/35127] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:14:21,933 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 23:14:21,933 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 23:14:21,933 INFO [Listener at jenkins-hbase4.apache.org/35127] procedure2.ProcedureExecutor(629): Stopping 2023-07-13 23:14:21,933 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 23:14:21,933 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:14:21,933 DEBUG [Listener at jenkins-hbase4.apache.org/35127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a5c9e14 to 127.0.0.1:63739 2023-07-13 23:14:21,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:14:21,933 DEBUG [Listener at jenkins-hbase4.apache.org/35127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:21,933 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 23:14:21,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:14:21,934 INFO [Listener at jenkins-hbase4.apache.org/35127] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37295,1689289892196' ***** 2023-07-13 23:14:21,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:14:21,934 DEBUG [Listener at jenkins-hbase4.apache.org/35127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:21,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:14:21,934 INFO [Listener at jenkins-hbase4.apache.org/35127] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 23:14:21,934 INFO [Listener at jenkins-hbase4.apache.org/35127] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43615,1689289892304' ***** 2023-07-13 23:14:21,934 DEBUG [Listener at jenkins-hbase4.apache.org/35127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:21,934 INFO [Listener at jenkins-hbase4.apache.org/35127] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 23:14:21,934 INFO [RS:0;jenkins-hbase4:37295] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 23:14:21,935 INFO [Listener at jenkins-hbase4.apache.org/35127] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34053,1689289892354' ***** 2023-07-13 23:14:21,935 INFO [RS:1;jenkins-hbase4:43615] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 23:14:21,935 INFO [RS:0;jenkins-hbase4:37295] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 23:14:21,935 INFO [RS:1;jenkins-hbase4:43615] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 23:14:21,935 INFO [RS:0;jenkins-hbase4:37295] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 23:14:21,935 DEBUG [Listener at jenkins-hbase4.apache.org/35127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:21,935 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 23:14:21,935 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 23:14:21,935 INFO [RS:1;jenkins-hbase4:43615] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 23:14:21,935 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(3305): Received CLOSE for b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:14:21,935 INFO [Listener at jenkins-hbase4.apache.org/35127] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 23:14:21,935 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:14:21,936 INFO [RS:2;jenkins-hbase4:34053] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 23:14:21,936 DEBUG [RS:1;jenkins-hbase4:43615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19afe29d to 127.0.0.1:63739 2023-07-13 23:14:21,936 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 23:14:21,936 DEBUG [RS:1;jenkins-hbase4:43615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:21,936 INFO [RS:2;jenkins-hbase4:34053] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 23:14:21,938 INFO [RS:1;jenkins-hbase4:43615] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 23:14:21,936 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:14:21,938 INFO [RS:1;jenkins-hbase4:43615] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 23:14:21,939 INFO [RS:1;jenkins-hbase4:43615] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 23:14:21,938 INFO [RS:2;jenkins-hbase4:34053] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 23:14:21,939 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-13 23:14:21,938 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:21,939 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(3305): Received CLOSE for 2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:14:21,939 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:14:21,939 DEBUG [RS:2;jenkins-hbase4:34053] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20ad8ddf to 127.0.0.1:63739 2023-07-13 23:14:21,940 DEBUG [RS:2;jenkins-hbase4:34053] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:21,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b471ba8553f5b202f8c4c8eba9c2b9e9, disabling compactions & flushes 2023-07-13 23:14:21,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:14:21,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:14:21,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. after waiting 0 ms 2023-07-13 23:14:21,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:14:21,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b471ba8553f5b202f8c4c8eba9c2b9e9 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-13 23:14:21,938 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:21,938 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:21,939 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-13 23:14:21,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2572780f72ed08ee1d16faa85d9a322b, disabling compactions & flushes 2023-07-13 23:14:21,938 DEBUG [RS:0;jenkins-hbase4:37295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01730409 to 127.0.0.1:63739 2023-07-13 23:14:21,941 DEBUG [RS:0;jenkins-hbase4:37295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:21,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:14:21,941 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-13 23:14:21,941 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-13 23:14:21,942 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1478): Online Regions={2572780f72ed08ee1d16faa85d9a322b=hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b.} 2023-07-13 23:14:21,942 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-13 23:14:21,942 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1478): Online Regions={b471ba8553f5b202f8c4c8eba9c2b9e9=hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9.} 2023-07-13 23:14:21,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:14:21,941 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-13 23:14:21,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. after waiting 0 ms 2023-07-13 23:14:21,942 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-13 23:14:21,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:14:21,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-13 23:14:21,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2572780f72ed08ee1d16faa85d9a322b 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-13 23:14:21,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-13 23:14:21,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-13 23:14:21,943 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-13 23:14:21,943 DEBUG [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1504): Waiting on 2572780f72ed08ee1d16faa85d9a322b 2023-07-13 23:14:21,944 DEBUG [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1504): Waiting on b471ba8553f5b202f8c4c8eba9c2b9e9 2023-07-13 23:14:21,944 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-13 23:14:21,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b/.tmp/info/c528fbb156e2450abb9a8435b6b2cc80 2023-07-13 23:14:21,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9/.tmp/l/a53f70667f324ba9921dbd6333449214 2023-07-13 23:14:22,011 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/.tmp/info/405dfc365ba04c6c9532a297d81fd5d4 2023-07-13 23:14:22,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b/.tmp/info/c528fbb156e2450abb9a8435b6b2cc80 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b/info/c528fbb156e2450abb9a8435b6b2cc80 2023-07-13 23:14:22,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a53f70667f324ba9921dbd6333449214 2023-07-13 23:14:22,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9/.tmp/l/a53f70667f324ba9921dbd6333449214 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9/l/a53f70667f324ba9921dbd6333449214 2023-07-13 23:14:22,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b/info/c528fbb156e2450abb9a8435b6b2cc80, entries=2, sequenceid=6, filesize=4.8 K 2023-07-13 23:14:22,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2572780f72ed08ee1d16faa85d9a322b in 75ms, sequenceid=6, compaction requested=false 2023-07-13 23:14:22,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a53f70667f324ba9921dbd6333449214 2023-07-13 23:14:22,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9/l/a53f70667f324ba9921dbd6333449214, entries=7, sequenceid=18, filesize=5.2 K 2023-07-13 23:14:22,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 405dfc365ba04c6c9532a297d81fd5d4 2023-07-13 23:14:22,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for b471ba8553f5b202f8c4c8eba9c2b9e9 in 82ms, sequenceid=18, compaction requested=false 2023-07-13 23:14:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/namespace/2572780f72ed08ee1d16faa85d9a322b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:14:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:22,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:14:22,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2572780f72ed08ee1d16faa85d9a322b: 2023-07-13 23:14:22,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689289895405.2572780f72ed08ee1d16faa85d9a322b. 2023-07-13 23:14:22,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/acl/b471ba8553f5b202f8c4c8eba9c2b9e9/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-13 23:14:22,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:22,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:14:22,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b471ba8553f5b202f8c4c8eba9c2b9e9: 2023-07-13 23:14:22,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689289896167.b471ba8553f5b202f8c4c8eba9c2b9e9. 2023-07-13 23:14:22,041 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/.tmp/rep_barrier/d5cda29639984a21b6e6289084cb635d 2023-07-13 23:14:22,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5cda29639984a21b6e6289084cb635d 2023-07-13 23:14:22,144 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34053,1689289892354; all regions closed. 2023-07-13 23:14:22,144 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37295,1689289892196; all regions closed. 2023-07-13 23:14:22,145 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-13 23:14:22,166 DEBUG [RS:2;jenkins-hbase4:34053] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/oldWALs 2023-07-13 23:14:22,166 INFO [RS:2;jenkins-hbase4:34053] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34053%2C1689289892354:(num 1689289894701) 2023-07-13 23:14:22,166 DEBUG [RS:2;jenkins-hbase4:34053] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:22,166 INFO [RS:2;jenkins-hbase4:34053] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:22,167 INFO [RS:2;jenkins-hbase4:34053] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-13 23:14:22,167 INFO [RS:2;jenkins-hbase4:34053] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 23:14:22,167 INFO [RS:2;jenkins-hbase4:34053] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 23:14:22,167 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 23:14:22,167 INFO [RS:2;jenkins-hbase4:34053] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 23:14:22,169 INFO [RS:2;jenkins-hbase4:34053] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34053 2023-07-13 23:14:22,173 DEBUG [RS:0;jenkins-hbase4:37295] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/oldWALs 2023-07-13 23:14:22,173 INFO [RS:0;jenkins-hbase4:37295] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37295%2C1689289892196:(num 1689289894701) 2023-07-13 23:14:22,173 DEBUG [RS:0;jenkins-hbase4:37295] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:22,173 INFO [RS:0;jenkins-hbase4:37295] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:22,173 INFO [RS:0;jenkins-hbase4:37295] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-13 23:14:22,174 INFO [RS:0;jenkins-hbase4:37295] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 23:14:22,174 INFO [RS:0;jenkins-hbase4:37295] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 23:14:22,174 INFO [RS:0;jenkins-hbase4:37295] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 23:14:22,174 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 23:14:22,176 INFO [RS:0;jenkins-hbase4:37295] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37295 2023-07-13 23:14:22,177 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:14:22,177 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:22,177 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:22,177 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:14:22,178 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:22,178 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34053,1689289892354 2023-07-13 23:14:22,178 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:22,178 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:14:22,178 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:14:22,178 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37295,1689289892196 2023-07-13 23:14:22,178 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34053,1689289892354] 2023-07-13 23:14:22,179 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34053,1689289892354; numProcessing=1 2023-07-13 23:14:22,182 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34053,1689289892354 already deleted, retry=false 2023-07-13 23:14:22,182 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34053,1689289892354 expired; onlineServers=2 2023-07-13 23:14:22,182 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37295,1689289892196] 2023-07-13 23:14:22,182 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37295,1689289892196; numProcessing=2 2023-07-13 23:14:22,183 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37295,1689289892196 already deleted, retry=false 2023-07-13 23:14:22,183 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37295,1689289892196 expired; onlineServers=1 2023-07-13 23:14:22,281 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:22,281 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:34053-0x10160f49a930003, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:22,281 INFO [RS:2;jenkins-hbase4:34053] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34053,1689289892354; zookeeper connection closed. 2023-07-13 23:14:22,282 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f6c10da] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f6c10da 2023-07-13 23:14:22,345 DEBUG [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-13 23:14:22,381 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:22,381 INFO [RS:0;jenkins-hbase4:37295] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37295,1689289892196; zookeeper connection closed. 2023-07-13 23:14:22,382 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:37295-0x10160f49a930001, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:22,382 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66bb791f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66bb791f 2023-07-13 23:14:22,475 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/.tmp/table/5f776011d7ed4218a84fd731c0e5ad39 2023-07-13 23:14:22,479 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f776011d7ed4218a84fd731c0e5ad39 2023-07-13 23:14:22,480 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/.tmp/info/405dfc365ba04c6c9532a297d81fd5d4 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/info/405dfc365ba04c6c9532a297d81fd5d4 2023-07-13 23:14:22,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 405dfc365ba04c6c9532a297d81fd5d4 2023-07-13 23:14:22,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/info/405dfc365ba04c6c9532a297d81fd5d4, entries=48, sequenceid=131, filesize=10.3 K 2023-07-13 23:14:22,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/.tmp/rep_barrier/d5cda29639984a21b6e6289084cb635d as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/rep_barrier/d5cda29639984a21b6e6289084cb635d 2023-07-13 23:14:22,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5cda29639984a21b6e6289084cb635d 2023-07-13 23:14:22,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/rep_barrier/d5cda29639984a21b6e6289084cb635d, entries=13, sequenceid=131, filesize=6.4 K 2023-07-13 23:14:22,491 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/.tmp/table/5f776011d7ed4218a84fd731c0e5ad39 as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/table/5f776011d7ed4218a84fd731c0e5ad39 2023-07-13 23:14:22,495 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f776011d7ed4218a84fd731c0e5ad39 2023-07-13 23:14:22,495 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/table/5f776011d7ed4218a84fd731c0e5ad39, entries=24, sequenceid=131, filesize=6.9 K 2023-07-13 23:14:22,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 553ms, sequenceid=131, compaction requested=false 2023-07-13 23:14:22,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-13 23:14:22,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:22,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-13 23:14:22,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-13 23:14:22,506 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-13 23:14:22,506 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-13 23:14:22,523 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-13 23:14:22,523 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-13 23:14:22,545 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43615,1689289892304; all regions closed. 2023-07-13 23:14:22,554 DEBUG [RS:1;jenkins-hbase4:43615] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/oldWALs 2023-07-13 23:14:22,554 INFO [RS:1;jenkins-hbase4:43615] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43615%2C1689289892304.meta:.meta(num 1689289895020) 2023-07-13 23:14:22,566 DEBUG [RS:1;jenkins-hbase4:43615] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/oldWALs 2023-07-13 23:14:22,566 INFO [RS:1;jenkins-hbase4:43615] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43615%2C1689289892304:(num 1689289894701) 2023-07-13 23:14:22,566 DEBUG [RS:1;jenkins-hbase4:43615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:22,566 INFO [RS:1;jenkins-hbase4:43615] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:22,567 INFO [RS:1;jenkins-hbase4:43615] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-13 23:14:22,567 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 23:14:22,568 INFO [RS:1;jenkins-hbase4:43615] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43615 2023-07-13 23:14:22,570 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:22,571 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43615,1689289892304 2023-07-13 23:14:22,571 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43615,1689289892304] 2023-07-13 23:14:22,571 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43615,1689289892304; numProcessing=3 2023-07-13 23:14:22,572 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43615,1689289892304 already deleted, retry=false 2023-07-13 23:14:22,573 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43615,1689289892304 expired; onlineServers=0 2023-07-13 23:14:22,573 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46453,1689289890678' ***** 2023-07-13 23:14:22,573 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-13 23:14:22,573 DEBUG [M:0;jenkins-hbase4:46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d16eed0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-13 23:14:22,573 INFO [M:0;jenkins-hbase4:46453] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46453,1689289890678 2023-07-13 23:14:22,573 INFO [M:0;jenkins-hbase4:46453] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46453,1689289890678; all regions closed. 2023-07-13 23:14:22,573 DEBUG [M:0;jenkins-hbase4:46453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:22,573 DEBUG [M:0;jenkins-hbase4:46453] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-13 23:14:22,573 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-13 23:14:22,573 DEBUG [M:0;jenkins-hbase4:46453] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-13 23:14:22,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689289894168] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689289894168,5,FailOnTimeoutGroup] 2023-07-13 23:14:22,574 INFO [M:0;jenkins-hbase4:46453] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-13 23:14:22,574 INFO [M:0;jenkins-hbase4:46453] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-13 23:14:22,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689289894169] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689289894169,5,FailOnTimeoutGroup] 2023-07-13 23:14:22,574 INFO [M:0;jenkins-hbase4:46453] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-13 23:14:22,574 DEBUG [M:0;jenkins-hbase4:46453] master.HMaster(1512): Stopping service threads 2023-07-13 23:14:22,574 INFO [M:0;jenkins-hbase4:46453] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-13 23:14:22,574 ERROR [M:0;jenkins-hbase4:46453] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-13 23:14:22,575 INFO [M:0;jenkins-hbase4:46453] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-13 23:14:22,575 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-13 23:14:22,675 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:22,675 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): regionserver:43615-0x10160f49a930002, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:22,675 INFO [RS:1;jenkins-hbase4:43615] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43615,1689289892304; zookeeper connection closed. 2023-07-13 23:14:22,675 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@78ad996c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@78ad996c 2023-07-13 23:14:22,676 INFO [Listener at jenkins-hbase4.apache.org/35127] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-13 23:14:22,676 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-13 23:14:22,677 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:14:22,677 DEBUG [M:0;jenkins-hbase4:46453] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-07-13 23:14:22,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:14:22,678 DEBUG [M:0;jenkins-hbase4:46453] master.ActiveMasterManager(335): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-07-13 23:14:22,678 INFO [M:0;jenkins-hbase4:46453] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-13 23:14:22,678 INFO [M:0;jenkins-hbase4:46453] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-13 23:14:22,679 DEBUG [M:0;jenkins-hbase4:46453] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-13 23:14:22,679 INFO [M:0;jenkins-hbase4:46453] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:14:22,679 DEBUG [M:0;jenkins-hbase4:46453] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:14:22,679 DEBUG [M:0;jenkins-hbase4:46453] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-13 23:14:22,679 DEBUG [M:0;jenkins-hbase4:46453] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:14:22,679 INFO [M:0;jenkins-hbase4:46453] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.60 KB heapSize=451.84 KB 2023-07-13 23:14:22,708 INFO [M:0;jenkins-hbase4:46453] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.60 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a246a638eea646cd86febf2e8217944d 2023-07-13 23:14:22,714 INFO [M:0;jenkins-hbase4:46453] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a246a638eea646cd86febf2e8217944d 2023-07-13 23:14:22,715 DEBUG [M:0;jenkins-hbase4:46453] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a246a638eea646cd86febf2e8217944d as hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a246a638eea646cd86febf2e8217944d 2023-07-13 23:14:22,719 INFO [M:0;jenkins-hbase4:46453] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a246a638eea646cd86febf2e8217944d 2023-07-13 23:14:22,719 INFO [M:0;jenkins-hbase4:46453] regionserver.HStore(1080): Added hdfs://localhost:33689/user/jenkins/test-data/844dfafd-9da9-40a3-0d42-a70eef86ef29/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a246a638eea646cd86febf2e8217944d, entries=119, sequenceid=899, filesize=28.6 K 2023-07-13 23:14:22,721 INFO [M:0;jenkins-hbase4:46453] regionserver.HRegion(2948): Finished flush of dataSize ~375.60 KB/384615, heapSize ~451.83 KB/462672, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 42ms, sequenceid=899, compaction requested=false 2023-07-13 23:14:22,726 INFO [M:0;jenkins-hbase4:46453] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:14:22,726 DEBUG [M:0;jenkins-hbase4:46453] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 23:14:22,738 INFO [M:0;jenkins-hbase4:46453] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-13 23:14:22,739 INFO [M:0;jenkins-hbase4:46453] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46453 2023-07-13 23:14:22,743 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 23:14:22,744 DEBUG [M:0;jenkins-hbase4:46453] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46453,1689289890678 already deleted, retry=false 2023-07-13 23:14:22,847 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:22,847 INFO [M:0;jenkins-hbase4:46453] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46453,1689289890678; zookeeper connection closed. 2023-07-13 23:14:22,847 DEBUG [Listener at localhost/39383-EventThread] zookeeper.ZKWatcher(600): master:46453-0x10160f49a930000, quorum=127.0.0.1:63739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:22,848 WARN [Listener at jenkins-hbase4.apache.org/35127] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 23:14:22,853 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 23:14:22,959 WARN [BP-389405297-172.31.14.131-1689289886155 heartbeating to localhost/127.0.0.1:33689] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 23:14:22,959 WARN [BP-389405297-172.31.14.131-1689289886155 heartbeating to localhost/127.0.0.1:33689] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-389405297-172.31.14.131-1689289886155 (Datanode Uuid 7c7d8563-5a5d-4d31-b086-ea887a3e4482) service to localhost/127.0.0.1:33689 2023-07-13 23:14:22,961 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data5/current/BP-389405297-172.31.14.131-1689289886155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:22,962 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data6/current/BP-389405297-172.31.14.131-1689289886155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:22,964 WARN [Listener at jenkins-hbase4.apache.org/35127] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 23:14:22,989 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 23:14:23,096 WARN [BP-389405297-172.31.14.131-1689289886155 heartbeating to localhost/127.0.0.1:33689] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 23:14:23,096 WARN [BP-389405297-172.31.14.131-1689289886155 heartbeating to localhost/127.0.0.1:33689] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-389405297-172.31.14.131-1689289886155 (Datanode Uuid 8bde7aa9-4fdc-44d0-aa2c-d0adced80296) service to localhost/127.0.0.1:33689 2023-07-13 23:14:23,097 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data3/current/BP-389405297-172.31.14.131-1689289886155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:23,097 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data4/current/BP-389405297-172.31.14.131-1689289886155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:23,100 WARN [Listener at jenkins-hbase4.apache.org/35127] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 23:14:23,116 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 23:14:23,118 WARN [BP-389405297-172.31.14.131-1689289886155 heartbeating to localhost/127.0.0.1:33689] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 23:14:23,119 WARN [BP-389405297-172.31.14.131-1689289886155 heartbeating to localhost/127.0.0.1:33689] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-389405297-172.31.14.131-1689289886155 (Datanode Uuid 94aee38c-4c00-4ec5-a7cd-7ac8a1aa3f27) service to localhost/127.0.0.1:33689 2023-07-13 23:14:23,119 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data1/current/BP-389405297-172.31.14.131-1689289886155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:23,120 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1804755-7a76-0fa4-3d4e-339dcd807e16/cluster_6a3c08a4-1287-5dbd-c5d7-01aa64022c97/dfs/data/data2/current/BP-389405297-172.31.14.131-1689289886155] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:23,164 INFO [Listener at jenkins-hbase4.apache.org/35127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 23:14:23,295 INFO [Listener at jenkins-hbase4.apache.org/35127] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-13 23:14:23,433 INFO [Listener at jenkins-hbase4.apache.org/35127] hbase.HBaseTestingUtility(1293): Minicluster is down