2023-02-14 11:01:45,743 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-14 11:01:45,796 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=168, AvailableMemoryMB=7031 2023-02-14 11:01:46,068 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86 2023-02-14 11:01:46,075 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-14 11:01:46,076 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/cluster_79e85347-5204-a843-a291-fabdd627fb86, deleteOnExit=true 2023-02-14 11:01:46,076 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-14 11:01:46,077 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/test.cache.data in system properties and HBase conf 2023-02-14 11:01:46,077 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop.tmp.dir in system properties and HBase conf 2023-02-14 11:01:46,077 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop.log.dir in system properties and HBase conf 2023-02-14 11:01:46,078 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-14 11:01:46,078 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-14 11:01:46,078 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-14 11:01:46,185 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-14 11:01:46,632 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-14 11:01:46,636 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:01:46,637 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:01:46,637 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-14 11:01:46,637 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:01:46,638 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-14 11:01:46,638 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-14 11:01:46,638 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:01:46,638 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:01:46,639 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-14 11:01:46,639 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/nfs.dump.dir in system properties and HBase conf 2023-02-14 11:01:46,639 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/java.io.tmpdir in system properties and HBase conf 2023-02-14 11:01:46,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:01:46,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-14 11:01:46,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-14 11:01:47,199 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:01:47,204 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:01:47,550 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-14 11:01:47,746 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-14 11:01:47,762 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:01:47,804 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:01:47,841 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/java.io.tmpdir/Jetty_localhost_36113_hdfs____alocje/webapp 2023-02-14 11:01:48,002 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36113 2023-02-14 11:01:48,014 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:01:48,014 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:01:48,545 WARN [Listener at localhost/40851] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:01:48,642 WARN [Listener at localhost/40851] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:01:48,670 WARN [Listener at localhost/40851] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:01:48,679 INFO [Listener at localhost/40851] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:01:48,687 INFO [Listener at localhost/40851] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/java.io.tmpdir/Jetty_localhost_40295_datanode____yiv1dl/webapp 2023-02-14 11:01:48,808 INFO [Listener at localhost/40851] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40295 2023-02-14 11:01:49,259 WARN [Listener at localhost/44041] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:01:49,296 WARN [Listener at localhost/44041] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:01:49,300 WARN [Listener at localhost/44041] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:01:49,302 INFO [Listener at localhost/44041] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:01:49,311 INFO [Listener at localhost/44041] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/java.io.tmpdir/Jetty_localhost_40669_datanode____.24vr4s/webapp 2023-02-14 11:01:49,442 INFO [Listener at localhost/44041] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40669 2023-02-14 11:01:49,476 WARN [Listener at localhost/43295] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:01:49,831 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfa3cef35d77e097c: Processing first storage report for DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991 from datanode 8afdb919-0700-4103-baa8-87861fa7e3c3 2023-02-14 11:01:49,834 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfa3cef35d77e097c: from storage DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991 node DatanodeRegistration(127.0.0.1:38827, datanodeUuid=8afdb919-0700-4103-baa8-87861fa7e3c3, infoPort=42049, infoSecurePort=0, ipcPort=43295, storageInfo=lv=-57;cid=testClusterID;nsid=305547388;c=1676372507283), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-02-14 11:01:49,834 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x55687de3b9d44969: Processing first storage report for DS-c9f61845-ab9d-44d4-9873-708325d384d4 from datanode 9ed847e7-03fb-4633-8e71-64a3de9f42c8 2023-02-14 11:01:49,834 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x55687de3b9d44969: from storage DS-c9f61845-ab9d-44d4-9873-708325d384d4 node DatanodeRegistration(127.0.0.1:36315, datanodeUuid=9ed847e7-03fb-4633-8e71-64a3de9f42c8, infoPort=39231, infoSecurePort=0, ipcPort=44041, storageInfo=lv=-57;cid=testClusterID;nsid=305547388;c=1676372507283), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:01:49,834 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfa3cef35d77e097c: Processing first storage report for DS-235308ef-558c-45e0-be44-ecd6139a7d6b from datanode 8afdb919-0700-4103-baa8-87861fa7e3c3 2023-02-14 11:01:49,835 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfa3cef35d77e097c: from storage DS-235308ef-558c-45e0-be44-ecd6139a7d6b node DatanodeRegistration(127.0.0.1:38827, datanodeUuid=8afdb919-0700-4103-baa8-87861fa7e3c3, infoPort=42049, infoSecurePort=0, ipcPort=43295, storageInfo=lv=-57;cid=testClusterID;nsid=305547388;c=1676372507283), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:01:49,835 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x55687de3b9d44969: Processing first storage report for DS-2a39c286-4d46-46fd-a764-4089e4352556 from datanode 9ed847e7-03fb-4633-8e71-64a3de9f42c8 2023-02-14 11:01:49,835 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x55687de3b9d44969: from storage DS-2a39c286-4d46-46fd-a764-4089e4352556 node DatanodeRegistration(127.0.0.1:36315, datanodeUuid=9ed847e7-03fb-4633-8e71-64a3de9f42c8, infoPort=39231, infoSecurePort=0, ipcPort=44041, storageInfo=lv=-57;cid=testClusterID;nsid=305547388;c=1676372507283), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:01:49,948 DEBUG [Listener at localhost/43295] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86 2023-02-14 11:01:50,054 INFO [Listener at localhost/43295] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/cluster_79e85347-5204-a843-a291-fabdd627fb86/zookeeper_0, clientPort=52840, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/cluster_79e85347-5204-a843-a291-fabdd627fb86/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/cluster_79e85347-5204-a843-a291-fabdd627fb86/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-14 11:01:50,074 INFO [Listener at localhost/43295] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52840 2023-02-14 11:01:50,083 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:50,085 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:50,841 INFO [Listener at localhost/43295] util.FSUtils(479): Created version file at hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964 with version=8 2023-02-14 11:01:50,841 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:50,843 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:50,847 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/hbase-staging 2023-02-14 11:01:51,181 INFO [Listener at localhost/43295] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-14 11:01:51,674 INFO [Listener at localhost/43295] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:01:51,707 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:01:51,708 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:01:51,708 INFO [Listener at localhost/43295] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:01:51,708 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:01:51,708 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:01:51,852 INFO [Listener at localhost/43295] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:01:51,927 DEBUG [Listener at localhost/43295] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-14 11:01:52,021 INFO [Listener at localhost/43295] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45133 2023-02-14 11:01:52,032 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:52,034 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:52,057 INFO [Listener at localhost/43295] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45133 connecting to ZooKeeper ensemble=127.0.0.1:52840 2023-02-14 11:01:52,108 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:451330x0, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:01:52,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45133-0x100527e6f160000 connected 2023-02-14 11:01:52,141 DEBUG [Listener at localhost/43295] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:01:52,141 DEBUG [Listener at localhost/43295] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:01:52,145 DEBUG [Listener at localhost/43295] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:01:52,155 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45133 2023-02-14 11:01:52,155 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45133 2023-02-14 11:01:52,156 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45133 2023-02-14 11:01:52,157 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45133 2023-02-14 11:01:52,157 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45133 2023-02-14 11:01:52,164 INFO [Listener at localhost/43295] master.HMaster(444): hbase.rootdir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964, hbase.cluster.distributed=false 2023-02-14 11:01:52,235 INFO [Listener at localhost/43295] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:01:52,235 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:01:52,235 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:01:52,235 INFO [Listener at localhost/43295] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:01:52,235 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:01:52,236 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:01:52,240 INFO [Listener at localhost/43295] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:01:52,243 INFO [Listener at localhost/43295] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36959 2023-02-14 11:01:52,246 INFO [Listener at localhost/43295] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:01:52,253 DEBUG [Listener at localhost/43295] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:01:52,254 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:52,256 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:52,258 INFO [Listener at localhost/43295] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36959 connecting to ZooKeeper ensemble=127.0.0.1:52840 2023-02-14 11:01:52,263 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:369590x0, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:01:52,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36959-0x100527e6f160001 connected 2023-02-14 11:01:52,264 DEBUG [Listener at localhost/43295] zookeeper.ZKUtil(164): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:01:52,266 DEBUG [Listener at localhost/43295] zookeeper.ZKUtil(164): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:01:52,266 DEBUG [Listener at localhost/43295] zookeeper.ZKUtil(164): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:01:52,268 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36959 2023-02-14 11:01:52,268 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36959 2023-02-14 11:01:52,271 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36959 2023-02-14 11:01:52,272 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36959 2023-02-14 11:01:52,272 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36959 2023-02-14 11:01:52,285 INFO [Listener at localhost/43295] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:01:52,285 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:01:52,285 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:01:52,286 INFO [Listener at localhost/43295] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:01:52,286 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:01:52,286 INFO [Listener at localhost/43295] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:01:52,286 INFO [Listener at localhost/43295] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:01:52,287 INFO [Listener at localhost/43295] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32997 2023-02-14 11:01:52,288 INFO [Listener at localhost/43295] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:01:52,291 DEBUG [Listener at localhost/43295] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:01:52,291 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:52,294 INFO [Listener at localhost/43295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:52,297 INFO [Listener at localhost/43295] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32997 connecting to ZooKeeper ensemble=127.0.0.1:52840 2023-02-14 11:01:52,302 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:329970x0, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:01:52,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32997-0x100527e6f160002 connected 2023-02-14 11:01:52,308 DEBUG [Listener at localhost/43295] zookeeper.ZKUtil(164): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:01:52,309 DEBUG [Listener at localhost/43295] zookeeper.ZKUtil(164): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:01:52,310 DEBUG [Listener at localhost/43295] zookeeper.ZKUtil(164): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:01:52,315 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32997 2023-02-14 11:01:52,315 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32997 2023-02-14 11:01:52,316 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32997 2023-02-14 11:01:52,323 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32997 2023-02-14 11:01:52,323 DEBUG [Listener at localhost/43295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32997 2023-02-14 11:01:52,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:01:52,336 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:01:52,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:01:52,358 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:01:52,358 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:01:52,358 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:01:52,359 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:01:52,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:01:52,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45133,1676372511006 from backup master directory 2023-02-14 11:01:52,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:01:52,367 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:01:52,367 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:01:52,368 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:01:52,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:01:52,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-14 11:01:52,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-14 11:01:52,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/hbase.id with ID: cd95867f-f85d-45d3-b074-f028a8ded54d 2023-02-14 11:01:52,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:01:52,541 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:01:52,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6fcb3eec to 127.0.0.1:52840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:01:52,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@526741c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:01:52,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:01:52,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-14 11:01:52,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-14 11:01:52,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-14 11:01:52,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-14 11:01:52,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-14 11:01:52,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:01:52,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/data/master/store-tmp 2023-02-14 11:01:52,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:52,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:01:52,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:01:52,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:01:52,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:01:52,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:01:52,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:01:52,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:01:52,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/WALs/jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:01:52,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45133%2C1676372511006, suffix=, logDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/WALs/jenkins-hbase4.apache.org,45133,1676372511006, archiveDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/oldWALs, maxLogs=10 2023-02-14 11:01:52,851 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38827,DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991,DISK] 2023-02-14 11:01:52,851 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36315,DS-c9f61845-ab9d-44d4-9873-708325d384d4,DISK] 2023-02-14 11:01:52,860 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-14 11:01:52,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/WALs/jenkins-hbase4.apache.org,45133,1676372511006/jenkins-hbase4.apache.org%2C45133%2C1676372511006.1676372512801 2023-02-14 11:01:52,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36315,DS-c9f61845-ab9d-44d4-9873-708325d384d4,DISK], DatanodeInfoWithStorage[127.0.0.1:38827,DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991,DISK]] 2023-02-14 11:01:52,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:01:52,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:52,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:01:52,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:01:53,001 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:01:53,008 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-14 11:01:53,036 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-14 11:01:53,048 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:53,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:01:53,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:01:53,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:01:53,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:53,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70408522, jitterRate=0.04916873574256897}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:01:53,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:01:53,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-14 11:01:53,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-14 11:01:53,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-14 11:01:53,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-14 11:01:53,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-14 11:01:53,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-14 11:01:53,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-14 11:01:53,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-14 11:01:53,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-14 11:01:53,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-14 11:01:53,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-14 11:01:53,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-14 11:01:53,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-14 11:01:53,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-14 11:01:53,232 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:01:53,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-14 11:01:53,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-14 11:01:53,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-14 11:01:53,260 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:01:53,260 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:01:53,260 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:01:53,260 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:01:53,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45133,1676372511006, sessionid=0x100527e6f160000, setting cluster-up flag (Was=false) 2023-02-14 11:01:53,282 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:01:53,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-14 11:01:53,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:01:53,295 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:01:53,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-14 11:01:53,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:01:53,311 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.hbase-snapshot/.tmp 2023-02-14 11:01:53,329 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(952): ClusterId : cd95867f-f85d-45d3-b074-f028a8ded54d 2023-02-14 11:01:53,329 INFO [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(952): ClusterId : cd95867f-f85d-45d3-b074-f028a8ded54d 2023-02-14 11:01:53,335 DEBUG [RS:0;jenkins-hbase4:36959] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:01:53,335 DEBUG [RS:1;jenkins-hbase4:32997] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:01:53,342 DEBUG [RS:1;jenkins-hbase4:32997] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:01:53,342 DEBUG [RS:0;jenkins-hbase4:36959] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:01:53,342 DEBUG [RS:1;jenkins-hbase4:32997] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:01:53,342 DEBUG [RS:0;jenkins-hbase4:36959] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:01:53,346 DEBUG [RS:0;jenkins-hbase4:36959] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:01:53,346 DEBUG [RS:1;jenkins-hbase4:32997] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:01:53,347 DEBUG [RS:0;jenkins-hbase4:36959] zookeeper.ReadOnlyZKClient(139): Connect 0x328b66e1 to 127.0.0.1:52840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:01:53,347 DEBUG [RS:1;jenkins-hbase4:32997] zookeeper.ReadOnlyZKClient(139): Connect 0x279aa8b0 to 127.0.0.1:52840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:01:53,361 DEBUG [RS:0;jenkins-hbase4:36959] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c4c8ec0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:01:53,361 DEBUG [RS:1;jenkins-hbase4:32997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@295d5233, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:01:53,362 DEBUG [RS:0;jenkins-hbase4:36959] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38730d91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:01:53,362 DEBUG [RS:1;jenkins-hbase4:32997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d62c3c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:01:53,390 DEBUG [RS:1;jenkins-hbase4:32997] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:32997 2023-02-14 11:01:53,390 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36959 2023-02-14 11:01:53,395 INFO [RS:0;jenkins-hbase4:36959] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:01:53,395 INFO [RS:0;jenkins-hbase4:36959] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:01:53,396 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:01:53,395 INFO [RS:1;jenkins-hbase4:32997] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:01:53,396 INFO [RS:1;jenkins-hbase4:32997] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:01:53,396 DEBUG [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:01:53,399 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45133,1676372511006 with isa=jenkins-hbase4.apache.org/172.31.14.131:36959, startcode=1676372512234 2023-02-14 11:01:53,399 INFO [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45133,1676372511006 with isa=jenkins-hbase4.apache.org/172.31.14.131:32997, startcode=1676372512284 2023-02-14 11:01:53,426 DEBUG [RS:0;jenkins-hbase4:36959] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:01:53,428 DEBUG [RS:1;jenkins-hbase4:32997] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:01:53,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-14 11:01:53,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:01:53,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:01:53,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:01:53,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:01:53,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-14 11:01:53,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:53,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:01:53,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:53,483 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44577, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:01:53,483 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36803, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:01:53,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676372543484 2023-02-14 11:01:53,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-14 11:01:53,492 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:01:53,493 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-14 11:01:53,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45133] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-14 11:01:53,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-14 11:01:53,499 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:01:53,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-14 11:01:53,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-14 11:01:53,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-14 11:01:53,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-14 11:01:53,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-14 11:01:53,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:53,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-14 11:01:53,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-14 11:01:53,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-14 11:01:53,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-14 11:01:53,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-14 11:01:53,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372513521,5,FailOnTimeoutGroup] 2023-02-14 11:01:53,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372513521,5,FailOnTimeoutGroup] 2023-02-14 11:01:53,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:53,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-14 11:01:53,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:53,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:53,533 DEBUG [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(2829): Master is not running yet 2023-02-14 11:01:53,533 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(2829): Master is not running yet 2023-02-14 11:01:53,534 WARN [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-14 11:01:53,534 WARN [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-14 11:01:53,539 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:01:53,540 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:01:53,540 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964 2023-02-14 11:01:53,557 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:53,559 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:01:53,563 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/info 2023-02-14 11:01:53,564 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:01:53,565 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:53,565 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:01:53,567 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:01:53,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:01:53,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:53,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:01:53,572 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/table 2023-02-14 11:01:53,573 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:01:53,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:53,575 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740 2023-02-14 11:01:53,576 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740 2023-02-14 11:01:53,580 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:01:53,582 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:01:53,587 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:53,589 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62841175, jitterRate=-0.06359352171421051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:01:53,589 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:01:53,589 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:01:53,589 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:01:53,589 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:01:53,589 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:01:53,589 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:01:53,591 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:01:53,591 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:01:53,597 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:01:53,597 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-14 11:01:53,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-14 11:01:53,623 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-14 11:01:53,626 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-14 11:01:53,776 WARN [jenkins-hbase4:45133] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-14 11:01:54,535 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45133,1676372511006 with isa=jenkins-hbase4.apache.org/172.31.14.131:36959, startcode=1676372512234 2023-02-14 11:01:54,535 INFO [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45133,1676372511006 with isa=jenkins-hbase4.apache.org/172.31.14.131:32997, startcode=1676372512284 2023-02-14 11:01:54,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:54,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45133] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:54,550 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964 2023-02-14 11:01:54,550 DEBUG [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964 2023-02-14 11:01:54,550 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40851 2023-02-14 11:01:54,550 DEBUG [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40851 2023-02-14 11:01:54,550 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:01:54,550 DEBUG [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:01:54,555 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:01:54,565 DEBUG [RS:1;jenkins-hbase4:32997] zookeeper.ZKUtil(162): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:54,565 WARN [RS:1;jenkins-hbase4:32997] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:01:54,565 INFO [RS:1;jenkins-hbase4:32997] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:01:54,565 DEBUG [RS:0;jenkins-hbase4:36959] zookeeper.ZKUtil(162): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:54,565 DEBUG [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/WALs/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:54,565 WARN [RS:0;jenkins-hbase4:36959] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:01:54,566 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32997,1676372512284] 2023-02-14 11:01:54,566 INFO [RS:0;jenkins-hbase4:36959] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:01:54,566 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36959,1676372512234] 2023-02-14 11:01:54,566 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/WALs/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:54,577 DEBUG [RS:1;jenkins-hbase4:32997] zookeeper.ZKUtil(162): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:54,577 DEBUG [RS:0;jenkins-hbase4:36959] zookeeper.ZKUtil(162): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:54,577 DEBUG [RS:1;jenkins-hbase4:32997] zookeeper.ZKUtil(162): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:54,578 DEBUG [RS:0;jenkins-hbase4:36959] zookeeper.ZKUtil(162): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:54,589 DEBUG [RS:1;jenkins-hbase4:32997] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:01:54,589 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:01:54,599 INFO [RS:1;jenkins-hbase4:32997] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:01:54,599 INFO [RS:0;jenkins-hbase4:36959] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:01:54,620 INFO [RS:0;jenkins-hbase4:36959] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:01:54,620 INFO [RS:1;jenkins-hbase4:32997] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:01:54,625 INFO [RS:0;jenkins-hbase4:36959] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:01:54,625 INFO [RS:1;jenkins-hbase4:32997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:01:54,625 INFO [RS:0;jenkins-hbase4:36959] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,625 INFO [RS:1;jenkins-hbase4:32997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,627 INFO [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:01:54,627 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:01:54,635 INFO [RS:0;jenkins-hbase4:36959] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,635 INFO [RS:1;jenkins-hbase4:32997] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,636 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,636 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,636 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,636 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,636 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,636 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,637 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,637 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,637 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,637 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,637 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:01:54,637 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:01:54,637 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,637 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,637 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,637 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,638 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,638 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,638 DEBUG [RS:0;jenkins-hbase4:36959] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,638 DEBUG [RS:1;jenkins-hbase4:32997] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:01:54,639 INFO [RS:1;jenkins-hbase4:32997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,639 INFO [RS:0;jenkins-hbase4:36959] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,639 INFO [RS:1;jenkins-hbase4:32997] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,639 INFO [RS:0;jenkins-hbase4:36959] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,640 INFO [RS:1;jenkins-hbase4:32997] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,640 INFO [RS:0;jenkins-hbase4:36959] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,657 INFO [RS:1;jenkins-hbase4:32997] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:01:54,657 INFO [RS:0;jenkins-hbase4:36959] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:01:54,662 INFO [RS:1;jenkins-hbase4:32997] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32997,1676372512284-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,662 INFO [RS:0;jenkins-hbase4:36959] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36959,1676372512234-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:54,686 INFO [RS:1;jenkins-hbase4:32997] regionserver.Replication(203): jenkins-hbase4.apache.org,32997,1676372512284 started 2023-02-14 11:01:54,687 INFO [RS:0;jenkins-hbase4:36959] regionserver.Replication(203): jenkins-hbase4.apache.org,36959,1676372512234 started 2023-02-14 11:01:54,687 INFO [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,32997,1676372512284, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32997, sessionid=0x100527e6f160002 2023-02-14 11:01:54,687 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36959,1676372512234, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36959, sessionid=0x100527e6f160001 2023-02-14 11:01:54,687 DEBUG [RS:1;jenkins-hbase4:32997] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:01:54,687 DEBUG [RS:0;jenkins-hbase4:36959] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:01:54,687 DEBUG [RS:1;jenkins-hbase4:32997] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:54,687 DEBUG [RS:0;jenkins-hbase4:36959] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:54,688 DEBUG [RS:1;jenkins-hbase4:32997] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32997,1676372512284' 2023-02-14 11:01:54,688 DEBUG [RS:0;jenkins-hbase4:36959] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36959,1676372512234' 2023-02-14 11:01:54,688 DEBUG [RS:1;jenkins-hbase4:32997] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:01:54,688 DEBUG [RS:0;jenkins-hbase4:36959] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:01:54,689 DEBUG [RS:0;jenkins-hbase4:36959] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:01:54,689 DEBUG [RS:1;jenkins-hbase4:32997] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:01:54,690 DEBUG [RS:0;jenkins-hbase4:36959] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:01:54,690 DEBUG [RS:1;jenkins-hbase4:32997] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:01:54,690 DEBUG [RS:0;jenkins-hbase4:36959] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:01:54,690 DEBUG [RS:1;jenkins-hbase4:32997] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:01:54,690 DEBUG [RS:0;jenkins-hbase4:36959] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:54,690 DEBUG [RS:1;jenkins-hbase4:32997] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:54,691 DEBUG [RS:0;jenkins-hbase4:36959] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36959,1676372512234' 2023-02-14 11:01:54,691 DEBUG [RS:0;jenkins-hbase4:36959] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:01:54,691 DEBUG [RS:1;jenkins-hbase4:32997] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32997,1676372512284' 2023-02-14 11:01:54,691 DEBUG [RS:1;jenkins-hbase4:32997] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:01:54,691 DEBUG [RS:0;jenkins-hbase4:36959] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:01:54,692 DEBUG [RS:1;jenkins-hbase4:32997] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:01:54,692 DEBUG [RS:0;jenkins-hbase4:36959] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:01:54,692 INFO [RS:0;jenkins-hbase4:36959] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:01:54,692 INFO [RS:0;jenkins-hbase4:36959] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:01:54,692 DEBUG [RS:1;jenkins-hbase4:32997] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:01:54,692 INFO [RS:1;jenkins-hbase4:32997] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:01:54,693 INFO [RS:1;jenkins-hbase4:32997] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:01:54,779 DEBUG [jenkins-hbase4:45133] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-14 11:01:54,783 DEBUG [jenkins-hbase4:45133] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:01:54,790 DEBUG [jenkins-hbase4:45133] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:01:54,790 DEBUG [jenkins-hbase4:45133] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:01:54,790 DEBUG [jenkins-hbase4:45133] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:01:54,793 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36959,1676372512234, state=OPENING 2023-02-14 11:01:54,801 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-14 11:01:54,802 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:01:54,803 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:01:54,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:01:54,993 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:54,996 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:01:54,999 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45556, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:01:55,013 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-14 11:01:55,014 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:01:55,017 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36959%2C1676372512234.meta, suffix=.meta, logDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/WALs/jenkins-hbase4.apache.org,36959,1676372512234, archiveDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/oldWALs, maxLogs=32 2023-02-14 11:01:55,038 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38827,DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991,DISK] 2023-02-14 11:01:55,038 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36315,DS-c9f61845-ab9d-44d4-9873-708325d384d4,DISK] 2023-02-14 11:01:55,043 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/WALs/jenkins-hbase4.apache.org,36959,1676372512234/jenkins-hbase4.apache.org%2C36959%2C1676372512234.meta.1676372515020.meta 2023-02-14 11:01:55,044 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38827,DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991,DISK], DatanodeInfoWithStorage[127.0.0.1:36315,DS-c9f61845-ab9d-44d4-9873-708325d384d4,DISK]] 2023-02-14 11:01:55,044 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:01:55,046 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-14 11:01:55,068 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-14 11:01:55,074 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-14 11:01:55,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-14 11:01:55,080 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:55,080 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-14 11:01:55,080 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-14 11:01:55,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:01:55,085 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/info 2023-02-14 11:01:55,085 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/info 2023-02-14 11:01:55,086 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:01:55,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:55,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:01:55,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:01:55,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:01:55,089 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:01:55,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:55,091 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:01:55,092 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/table 2023-02-14 11:01:55,092 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/table 2023-02-14 11:01:55,093 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:01:55,094 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:55,096 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740 2023-02-14 11:01:55,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740 2023-02-14 11:01:55,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:01:55,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:01:55,108 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74354162, jitterRate=0.10796335339546204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:01:55,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:01:55,121 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676372514985 2023-02-14 11:01:55,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-14 11:01:55,141 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-14 11:01:55,141 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36959,1676372512234, state=OPEN 2023-02-14 11:01:55,144 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-14 11:01:55,144 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:01:55,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-14 11:01:55,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36959,1676372512234 in 337 msec 2023-02-14 11:01:55,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-14 11:01:55,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5400 sec 2023-02-14 11:01:55,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7760 sec 2023-02-14 11:01:55,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676372515160, completionTime=-1 2023-02-14 11:01:55,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-14 11:01:55,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-14 11:01:55,238 DEBUG [hconnection-0x53144a1d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:01:55,241 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:01:55,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-14 11:01:55,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676372575262 2023-02-14 11:01:55,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676372635263 2023-02-14 11:01:55,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 102 msec 2023-02-14 11:01:55,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45133,1676372511006-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:55,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45133,1676372511006-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:55,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45133,1676372511006-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:55,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45133, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:55,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-14 11:01:55,303 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-14 11:01:55,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-14 11:01:55,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:01:55,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-14 11:01:55,328 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:01:55,331 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:01:55,354 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:01:55,357 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca empty. 2023-02-14 11:01:55,357 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:01:55,357 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-14 11:01:55,385 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-14 11:01:55,387 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e96a3f1fb290eceae6863cbf72f676ca, NAME => 'hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:55,449 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:55,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e96a3f1fb290eceae6863cbf72f676ca, disabling compactions & flushes 2023-02-14 11:01:55,450 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:01:55,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:01:55,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. after waiting 0 ms 2023-02-14 11:01:55,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:01:55,450 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:01:55,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e96a3f1fb290eceae6863cbf72f676ca: 2023-02-14 11:01:55,459 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:01:55,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372515462"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372515462"}]},"ts":"1676372515462"} 2023-02-14 11:01:55,518 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:01:55,520 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:01:55,525 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372515520"}]},"ts":"1676372515520"} 2023-02-14 11:01:55,532 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-14 11:01:55,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:01:55,538 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:01:55,538 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:01:55,538 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:01:55,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e96a3f1fb290eceae6863cbf72f676ca, ASSIGN}] 2023-02-14 11:01:55,544 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e96a3f1fb290eceae6863cbf72f676ca, ASSIGN 2023-02-14 11:01:55,547 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e96a3f1fb290eceae6863cbf72f676ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36959,1676372512234; forceNewPlan=false, retain=false 2023-02-14 11:01:55,699 INFO [jenkins-hbase4:45133] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:01:55,701 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e96a3f1fb290eceae6863cbf72f676ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:55,701 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372515700"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372515700"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372515700"}]},"ts":"1676372515700"} 2023-02-14 11:01:55,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e96a3f1fb290eceae6863cbf72f676ca, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:01:55,708 INFO [RS:1;jenkins-hbase4:32997] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32997%2C1676372512284, suffix=, logDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/WALs/jenkins-hbase4.apache.org,32997,1676372512284, archiveDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/oldWALs, maxLogs=32 2023-02-14 11:01:55,708 INFO [RS:0;jenkins-hbase4:36959] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36959%2C1676372512234, suffix=, logDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/WALs/jenkins-hbase4.apache.org,36959,1676372512234, archiveDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/oldWALs, maxLogs=32 2023-02-14 11:01:55,731 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38827,DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991,DISK] 2023-02-14 11:01:55,731 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36315,DS-c9f61845-ab9d-44d4-9873-708325d384d4,DISK] 2023-02-14 11:01:55,732 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38827,DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991,DISK] 2023-02-14 11:01:55,734 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36315,DS-c9f61845-ab9d-44d4-9873-708325d384d4,DISK] 2023-02-14 11:01:55,737 INFO [RS:1;jenkins-hbase4:32997] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/WALs/jenkins-hbase4.apache.org,32997,1676372512284/jenkins-hbase4.apache.org%2C32997%2C1676372512284.1676372515710 2023-02-14 11:01:55,738 DEBUG [RS:1;jenkins-hbase4:32997] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38827,DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991,DISK], DatanodeInfoWithStorage[127.0.0.1:36315,DS-c9f61845-ab9d-44d4-9873-708325d384d4,DISK]] 2023-02-14 11:01:55,741 INFO [RS:0;jenkins-hbase4:36959] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/WALs/jenkins-hbase4.apache.org,36959,1676372512234/jenkins-hbase4.apache.org%2C36959%2C1676372512234.1676372515712 2023-02-14 11:01:55,741 DEBUG [RS:0;jenkins-hbase4:36959] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38827,DS-c390aa54-8b56-4d4d-876e-3ee9a6bcd991,DISK], DatanodeInfoWithStorage[127.0.0.1:36315,DS-c9f61845-ab9d-44d4-9873-708325d384d4,DISK]] 2023-02-14 11:01:55,871 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:01:55,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e96a3f1fb290eceae6863cbf72f676ca, NAME => 'hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:01:55,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:01:55,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:55,874 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:01:55,874 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:01:55,878 INFO [StoreOpener-e96a3f1fb290eceae6863cbf72f676ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:01:55,881 DEBUG [StoreOpener-e96a3f1fb290eceae6863cbf72f676ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca/info 2023-02-14 11:01:55,881 DEBUG [StoreOpener-e96a3f1fb290eceae6863cbf72f676ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca/info 2023-02-14 11:01:55,882 INFO [StoreOpener-e96a3f1fb290eceae6863cbf72f676ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e96a3f1fb290eceae6863cbf72f676ca columnFamilyName info 2023-02-14 11:01:55,883 INFO [StoreOpener-e96a3f1fb290eceae6863cbf72f676ca-1] regionserver.HStore(310): Store=e96a3f1fb290eceae6863cbf72f676ca/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:55,914 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:01:55,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:01:55,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:01:55,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:55,934 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e96a3f1fb290eceae6863cbf72f676ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68661252, jitterRate=0.023132383823394775}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:01:55,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e96a3f1fb290eceae6863cbf72f676ca: 2023-02-14 11:01:55,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca., pid=6, masterSystemTime=1676372515861 2023-02-14 11:01:55,941 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:01:55,942 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:01:55,943 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e96a3f1fb290eceae6863cbf72f676ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:55,943 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372515943"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372515943"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372515943"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372515943"}]},"ts":"1676372515943"} 2023-02-14 11:01:55,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-14 11:01:55,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e96a3f1fb290eceae6863cbf72f676ca, server=jenkins-hbase4.apache.org,36959,1676372512234 in 243 msec 2023-02-14 11:01:55,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-14 11:01:55,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e96a3f1fb290eceae6863cbf72f676ca, ASSIGN in 412 msec 2023-02-14 11:01:55,959 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:01:55,960 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372515959"}]},"ts":"1676372515959"} 2023-02-14 11:01:55,963 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-14 11:01:55,967 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:01:55,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 652 msec 2023-02-14 11:01:56,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-14 11:01:56,031 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:01:56,031 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:01:56,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-14 11:01:56,093 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:01:56,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-02-14 11:01:56,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-14 11:01:56,125 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:01:56,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-14 11:01:56,140 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-14 11:01:56,143 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-14 11:01:56,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.775sec 2023-02-14 11:01:56,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-14 11:01:56,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-14 11:01:56,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-14 11:01:56,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45133,1676372511006-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-14 11:01:56,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45133,1676372511006-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-14 11:01:56,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-14 11:01:56,236 DEBUG [Listener at localhost/43295] zookeeper.ReadOnlyZKClient(139): Connect 0x351d31b4 to 127.0.0.1:52840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:01:56,242 DEBUG [Listener at localhost/43295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d710525, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:01:56,296 DEBUG [hconnection-0x3b13242f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:01:56,309 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45578, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:01:56,320 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:01:56,320 DEBUG [Listener at localhost/43295] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-14 11:01:56,329 DEBUG [Listener at localhost/43295] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-14 11:01:56,332 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52338, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-14 11:01:56,338 INFO [Listener at localhost/43295] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-14 11:01:56,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-14 11:01:56,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-14 11:01:56,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:52338 deadline: 1676372576342, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-14 11:01:56,345 INFO [Listener at localhost/43295] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-14 11:01:56,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:01:56,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-14 11:01:56,362 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:01:56,364 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:01:56,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-14 11:01:56,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:01:56,387 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:56,387 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:56,387 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:56,388 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:56,388 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74 empty. 2023-02-14 11:01:56,389 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b empty. 2023-02-14 11:01:56,389 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:56,389 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:56,391 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:56,391 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:56,389 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:56,391 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:56,391 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79 empty. 2023-02-14 11:01:56,391 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869 empty. 2023-02-14 11:01:56,392 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43 empty. 2023-02-14 11:01:56,392 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:56,392 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,392 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358 empty. 2023-02-14 11:01:56,393 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089 empty. 2023-02-14 11:01:56,393 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:56,393 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:56,393 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090 empty. 2023-02-14 11:01:56,393 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b empty. 2023-02-14 11:01:56,394 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3 empty. 2023-02-14 11:01:56,394 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:56,394 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:56,394 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:56,394 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,394 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:56,394 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:56,394 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-14 11:01:56,417 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-14 11:01:56,420 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ac8776cda2c24f5cd82df312d2074d1b, NAME => 'testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,420 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e6fdfdc4338b690965517d43ed5fb869, NAME => 'testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,420 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 00e3bb45fb92cf21cd462231c045ce74, NAME => 'testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,461 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,461 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,462 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ac8776cda2c24f5cd82df312d2074d1b, disabling compactions & flushes 2023-02-14 11:01:56,463 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e6fdfdc4338b690965517d43ed5fb869, disabling compactions & flushes 2023-02-14 11:01:56,463 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:56,463 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:56,463 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. after waiting 0 ms 2023-02-14 11:01:56,463 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. after waiting 0 ms 2023-02-14 11:01:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:56,464 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ac8776cda2c24f5cd82df312d2074d1b: 2023-02-14 11:01:56,465 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c62d1c15ab4f6af58bd8dfd676f41e79, NAME => 'testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,463 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:56,465 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:56,465 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e6fdfdc4338b690965517d43ed5fb869: 2023-02-14 11:01:56,466 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ee0a8ce2f518cad240d966e483a534f3, NAME => 'testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,477 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,477 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 00e3bb45fb92cf21cd462231c045ce74, disabling compactions & flushes 2023-02-14 11:01:56,477 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:01:56,477 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:01:56,477 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. after waiting 0 ms 2023-02-14 11:01:56,478 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:01:56,478 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:01:56,478 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 00e3bb45fb92cf21cd462231c045ce74: 2023-02-14 11:01:56,478 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 07b909a3cc6c112a938a75d0808c8089, NAME => 'testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:01:56,496 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,497 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c62d1c15ab4f6af58bd8dfd676f41e79, disabling compactions & flushes 2023-02-14 11:01:56,497 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,497 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:01:56,497 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:01:56,497 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. after waiting 0 ms 2023-02-14 11:01:56,497 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:01:56,498 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:01:56,498 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c62d1c15ab4f6af58bd8dfd676f41e79: 2023-02-14 11:01:56,497 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ee0a8ce2f518cad240d966e483a534f3, disabling compactions & flushes 2023-02-14 11:01:56,498 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:01:56,499 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 870c3c3f7c4b8d77f340ccc3e823e358, NAME => 'testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,499 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:01:56,499 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. after waiting 0 ms 2023-02-14 11:01:56,499 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:01:56,499 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:01:56,499 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ee0a8ce2f518cad240d966e483a534f3: 2023-02-14 11:01:56,500 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => f18bb77a83aa40a46a7792e3ddbc6b43, NAME => 'testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,504 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,505 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 07b909a3cc6c112a938a75d0808c8089, disabling compactions & flushes 2023-02-14 11:01:56,505 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:01:56,505 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:01:56,505 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. after waiting 0 ms 2023-02-14 11:01:56,505 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:01:56,505 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:01:56,505 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 07b909a3cc6c112a938a75d0808c8089: 2023-02-14 11:01:56,506 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 230a2c8fc9943a86304aff565048b090, NAME => 'testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,533 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 870c3c3f7c4b8d77f340ccc3e823e358, disabling compactions & flushes 2023-02-14 11:01:56,533 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:01:56,533 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:01:56,533 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. after waiting 0 ms 2023-02-14 11:01:56,533 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:01:56,533 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:01:56,533 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 870c3c3f7c4b8d77f340ccc3e823e358: 2023-02-14 11:01:56,536 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => fd7a77d12080711034a1c568af3d5c0b, NAME => 'testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp 2023-02-14 11:01:56,536 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,537 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing f18bb77a83aa40a46a7792e3ddbc6b43, disabling compactions & flushes 2023-02-14 11:01:56,537 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:01:56,537 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:01:56,537 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. after waiting 0 ms 2023-02-14 11:01:56,537 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:01:56,537 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:01:56,537 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for f18bb77a83aa40a46a7792e3ddbc6b43: 2023-02-14 11:01:56,554 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,554 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 230a2c8fc9943a86304aff565048b090, disabling compactions & flushes 2023-02-14 11:01:56,555 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:01:56,555 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:01:56,555 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. after waiting 0 ms 2023-02-14 11:01:56,555 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:01:56,555 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:01:56,555 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 230a2c8fc9943a86304aff565048b090: 2023-02-14 11:01:56,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing fd7a77d12080711034a1c568af3d5c0b, disabling compactions & flushes 2023-02-14 11:01:56,561 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:01:56,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:01:56,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. after waiting 0 ms 2023-02-14 11:01:56,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:01:56,561 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:01:56,561 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for fd7a77d12080711034a1c568af3d5c0b: 2023-02-14 11:01:56,566 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:01:56,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,570 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372516568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372516568"}]},"ts":"1676372516568"} 2023-02-14 11:01:56,618 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-14 11:01:56,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:01:56,620 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372516620"}]},"ts":"1676372516620"} 2023-02-14 11:01:56,623 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-14 11:01:56,626 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:01:56,639 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:01:56,639 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:01:56,639 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:01:56,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=00e3bb45fb92cf21cd462231c045ce74, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ac8776cda2c24f5cd82df312d2074d1b, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e6fdfdc4338b690965517d43ed5fb869, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c62d1c15ab4f6af58bd8dfd676f41e79, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ee0a8ce2f518cad240d966e483a534f3, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=07b909a3cc6c112a938a75d0808c8089, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=870c3c3f7c4b8d77f340ccc3e823e358, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f18bb77a83aa40a46a7792e3ddbc6b43, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=230a2c8fc9943a86304aff565048b090, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fd7a77d12080711034a1c568af3d5c0b, ASSIGN}] 2023-02-14 11:01:56,644 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ac8776cda2c24f5cd82df312d2074d1b, ASSIGN 2023-02-14 11:01:56,645 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=00e3bb45fb92cf21cd462231c045ce74, ASSIGN 2023-02-14 11:01:56,645 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e6fdfdc4338b690965517d43ed5fb869, ASSIGN 2023-02-14 11:01:56,646 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c62d1c15ab4f6af58bd8dfd676f41e79, ASSIGN 2023-02-14 11:01:56,646 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ac8776cda2c24f5cd82df312d2074d1b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32997,1676372512284; forceNewPlan=false, retain=false 2023-02-14 11:01:56,647 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=00e3bb45fb92cf21cd462231c045ce74, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32997,1676372512284; forceNewPlan=false, retain=false 2023-02-14 11:01:56,647 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e6fdfdc4338b690965517d43ed5fb869, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36959,1676372512234; forceNewPlan=false, retain=false 2023-02-14 11:01:56,653 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c62d1c15ab4f6af58bd8dfd676f41e79, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36959,1676372512234; forceNewPlan=false, retain=false 2023-02-14 11:01:56,653 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fd7a77d12080711034a1c568af3d5c0b, ASSIGN 2023-02-14 11:01:56,653 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=230a2c8fc9943a86304aff565048b090, ASSIGN 2023-02-14 11:01:56,653 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f18bb77a83aa40a46a7792e3ddbc6b43, ASSIGN 2023-02-14 11:01:56,653 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=870c3c3f7c4b8d77f340ccc3e823e358, ASSIGN 2023-02-14 11:01:56,655 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=07b909a3cc6c112a938a75d0808c8089, ASSIGN 2023-02-14 11:01:56,655 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fd7a77d12080711034a1c568af3d5c0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36959,1676372512234; forceNewPlan=false, retain=false 2023-02-14 11:01:56,655 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f18bb77a83aa40a46a7792e3ddbc6b43, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36959,1676372512234; forceNewPlan=false, retain=false 2023-02-14 11:01:56,655 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=870c3c3f7c4b8d77f340ccc3e823e358, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32997,1676372512284; forceNewPlan=false, retain=false 2023-02-14 11:01:56,655 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=230a2c8fc9943a86304aff565048b090, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32997,1676372512284; forceNewPlan=false, retain=false 2023-02-14 11:01:56,657 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=07b909a3cc6c112a938a75d0808c8089, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36959,1676372512234; forceNewPlan=false, retain=false 2023-02-14 11:01:56,657 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ee0a8ce2f518cad240d966e483a534f3, ASSIGN 2023-02-14 11:01:56,658 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ee0a8ce2f518cad240d966e483a534f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32997,1676372512284; forceNewPlan=false, retain=false 2023-02-14 11:01:56,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:01:56,797 INFO [jenkins-hbase4:45133] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-14 11:01:56,801 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c62d1c15ab4f6af58bd8dfd676f41e79, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:56,801 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=07b909a3cc6c112a938a75d0808c8089, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:56,801 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=fd7a77d12080711034a1c568af3d5c0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:56,801 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e6fdfdc4338b690965517d43ed5fb869, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:56,801 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=f18bb77a83aa40a46a7792e3ddbc6b43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:56,802 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516801"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516801"}]},"ts":"1676372516801"} 2023-02-14 11:01:56,802 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372516801"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516801"}]},"ts":"1676372516801"} 2023-02-14 11:01:56,802 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516801"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516801"}]},"ts":"1676372516801"} 2023-02-14 11:01:56,802 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516801"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516801"}]},"ts":"1676372516801"} 2023-02-14 11:01:56,802 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516801"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516801"}]},"ts":"1676372516801"} 2023-02-14 11:01:56,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 07b909a3cc6c112a938a75d0808c8089, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:01:56,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=20, state=RUNNABLE; OpenRegionProcedure fd7a77d12080711034a1c568af3d5c0b, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:01:56,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure f18bb77a83aa40a46a7792e3ddbc6b43, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:01:56,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure c62d1c15ab4f6af58bd8dfd676f41e79, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:01:56,813 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=870c3c3f7c4b8d77f340ccc3e823e358, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:56,813 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516813"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516813"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516813"}]},"ts":"1676372516813"} 2023-02-14 11:01:56,814 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=00e3bb45fb92cf21cd462231c045ce74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:56,814 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372516814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516814"}]},"ts":"1676372516814"} 2023-02-14 11:01:56,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure e6fdfdc4338b690965517d43ed5fb869, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:01:56,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 870c3c3f7c4b8d77f340ccc3e823e358, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:01:56,820 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=230a2c8fc9943a86304aff565048b090, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:56,820 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516820"}]},"ts":"1676372516820"} 2023-02-14 11:01:56,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 00e3bb45fb92cf21cd462231c045ce74, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:01:56,823 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ee0a8ce2f518cad240d966e483a534f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:56,823 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 230a2c8fc9943a86304aff565048b090, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:01:56,823 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516823"}]},"ts":"1676372516823"} 2023-02-14 11:01:56,826 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ac8776cda2c24f5cd82df312d2074d1b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:56,826 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372516825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372516825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372516825"}]},"ts":"1676372516825"} 2023-02-14 11:01:56,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure ee0a8ce2f518cad240d966e483a534f3, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:01:56,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=12, state=RUNNABLE; OpenRegionProcedure ac8776cda2c24f5cd82df312d2074d1b, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:01:56,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:01:56,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fd7a77d12080711034a1c568af3d5c0b, NAME => 'testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-14 11:01:56,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,971 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,974 DEBUG [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/f1 2023-02-14 11:01:56,974 DEBUG [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/f1 2023-02-14 11:01:56,974 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd7a77d12080711034a1c568af3d5c0b columnFamilyName f1 2023-02-14 11:01:56,975 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:56,975 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] regionserver.HStore(310): Store=fd7a77d12080711034a1c568af3d5c0b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:56,976 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:01:56,976 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,979 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40562, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:01:56,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:01:56,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 230a2c8fc9943a86304aff565048b090, NAME => 'testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-14 11:01:56,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:56,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:56,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:56,986 DEBUG [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/f2 2023-02-14 11:01:56,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:56,987 DEBUG [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/f2 2023-02-14 11:01:56,987 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd7a77d12080711034a1c568af3d5c0b columnFamilyName f2 2023-02-14 11:01:56,988 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] regionserver.HStore(310): Store=fd7a77d12080711034a1c568af3d5c0b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:56,990 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:56,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,993 DEBUG [StoreOpener-230a2c8fc9943a86304aff565048b090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1 2023-02-14 11:01:56,993 DEBUG [StoreOpener-230a2c8fc9943a86304aff565048b090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1 2023-02-14 11:01:56,994 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 230a2c8fc9943a86304aff565048b090 columnFamilyName f1 2023-02-14 11:01:56,994 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(310): Store=230a2c8fc9943a86304aff565048b090/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:56,994 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:56,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:56,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:01:56,998 DEBUG [StoreOpener-230a2c8fc9943a86304aff565048b090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2 2023-02-14 11:01:56,998 DEBUG [StoreOpener-230a2c8fc9943a86304aff565048b090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2 2023-02-14 11:01:56,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:01:56,998 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 230a2c8fc9943a86304aff565048b090 columnFamilyName f2 2023-02-14 11:01:56,999 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(310): Store=230a2c8fc9943a86304aff565048b090/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:57,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:57,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fd7a77d12080711034a1c568af3d5c0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67592257, jitterRate=0.0072031170129776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fd7a77d12080711034a1c568af3d5c0b: 2023-02-14 11:01:57,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b., pid=22, masterSystemTime=1676372516959 2023-02-14 11:01:57,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:57,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:01:57,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:01:57,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:01:57,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c62d1c15ab4f6af58bd8dfd676f41e79, NAME => 'testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-14 11:01:57,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:57,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:57,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:57,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:57,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 230a2c8fc9943a86304aff565048b090 2023-02-14 11:01:57,009 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=fd7a77d12080711034a1c568af3d5c0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:57,009 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372517009"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517009"}]},"ts":"1676372517009"} 2023-02-14 11:01:57,012 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:57,016 DEBUG [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1 2023-02-14 11:01:57,016 DEBUG [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1 2023-02-14 11:01:57,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,018 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c62d1c15ab4f6af58bd8dfd676f41e79 columnFamilyName f1 2023-02-14 11:01:57,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 230a2c8fc9943a86304aff565048b090; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65862751, jitterRate=-0.018568530678749084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 230a2c8fc9943a86304aff565048b090: 2023-02-14 11:01:57,019 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(310): Store=c62d1c15ab4f6af58bd8dfd676f41e79/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,020 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:57,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=20 2023-02-14 11:01:57,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090., pid=28, masterSystemTime=1676372516975 2023-02-14 11:01:57,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=20, state=SUCCESS; OpenRegionProcedure fd7a77d12080711034a1c568af3d5c0b, server=jenkins-hbase4.apache.org,36959,1676372512234 in 208 msec 2023-02-14 11:01:57,024 DEBUG [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2 2023-02-14 11:01:57,024 DEBUG [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2 2023-02-14 11:01:57,025 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c62d1c15ab4f6af58bd8dfd676f41e79 columnFamilyName f2 2023-02-14 11:01:57,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fd7a77d12080711034a1c568af3d5c0b, ASSIGN in 381 msec 2023-02-14 11:01:57,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:01:57,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:01:57,027 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(310): Store=c62d1c15ab4f6af58bd8dfd676f41e79/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:01:57,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 00e3bb45fb92cf21cd462231c045ce74, NAME => 'testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-14 11:01:57,028 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=230a2c8fc9943a86304aff565048b090, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:57,028 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372517028"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517028"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517028"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517028"}]},"ts":"1676372517028"} 2023-02-14 11:01:57,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:57,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:57,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:57,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:57,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:57,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:57,033 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:57,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:57,036 DEBUG [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/f1 2023-02-14 11:01:57,036 DEBUG [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/f1 2023-02-14 11:01:57,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:01:57,037 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00e3bb45fb92cf21cd462231c045ce74 columnFamilyName f1 2023-02-14 11:01:57,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-14 11:01:57,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 230a2c8fc9943a86304aff565048b090, server=jenkins-hbase4.apache.org,32997,1676372512284 in 210 msec 2023-02-14 11:01:57,038 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] regionserver.HStore(310): Store=00e3bb45fb92cf21cd462231c045ce74/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,039 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:57,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=230a2c8fc9943a86304aff565048b090, ASSIGN in 397 msec 2023-02-14 11:01:57,042 DEBUG [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/f2 2023-02-14 11:01:57,042 DEBUG [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/f2 2023-02-14 11:01:57,044 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00e3bb45fb92cf21cd462231c045ce74 columnFamilyName f2 2023-02-14 11:01:57,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,046 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] regionserver.HStore(310): Store=00e3bb45fb92cf21cd462231c045ce74/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c62d1c15ab4f6af58bd8dfd676f41e79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69648310, jitterRate=0.037840694189071655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c62d1c15ab4f6af58bd8dfd676f41e79: 2023-02-14 11:01:57,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79., pid=24, masterSystemTime=1676372516959 2023-02-14 11:01:57,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:57,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:57,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:01:57,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:01:57,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:01:57,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 07b909a3cc6c112a938a75d0808c8089, NAME => 'testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-14 11:01:57,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:57,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:57,054 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c62d1c15ab4f6af58bd8dfd676f41e79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:57,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:57,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:57,054 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372517054"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517054"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517054"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517054"}]},"ts":"1676372517054"} 2023-02-14 11:01:57,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:57,056 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:57,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:01:57,060 DEBUG [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1 2023-02-14 11:01:57,061 DEBUG [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1 2023-02-14 11:01:57,062 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b909a3cc6c112a938a75d0808c8089 columnFamilyName f1 2023-02-14 11:01:57,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-14 11:01:57,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure c62d1c15ab4f6af58bd8dfd676f41e79, server=jenkins-hbase4.apache.org,36959,1676372512234 in 247 msec 2023-02-14 11:01:57,064 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(310): Store=07b909a3cc6c112a938a75d0808c8089/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c62d1c15ab4f6af58bd8dfd676f41e79, ASSIGN in 423 msec 2023-02-14 11:01:57,071 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:57,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 00e3bb45fb92cf21cd462231c045ce74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69407986, jitterRate=0.03425958752632141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 00e3bb45fb92cf21cd462231c045ce74: 2023-02-14 11:01:57,074 DEBUG [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2 2023-02-14 11:01:57,074 DEBUG [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2 2023-02-14 11:01:57,075 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b909a3cc6c112a938a75d0808c8089 columnFamilyName f2 2023-02-14 11:01:57,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74., pid=27, masterSystemTime=1676372516975 2023-02-14 11:01:57,075 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(310): Store=07b909a3cc6c112a938a75d0808c8089/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:57,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:57,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:01:57,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:01:57,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:01:57,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 870c3c3f7c4b8d77f340ccc3e823e358, NAME => 'testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-14 11:01:57,080 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=00e3bb45fb92cf21cd462231c045ce74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:57,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:57,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:57,080 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372517080"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517080"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517080"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517080"}]},"ts":"1676372517080"} 2023-02-14 11:01:57,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:57,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:57,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:57,084 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:57,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:01:57,087 DEBUG [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1 2023-02-14 11:01:57,087 DEBUG [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1 2023-02-14 11:01:57,088 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870c3c3f7c4b8d77f340ccc3e823e358 columnFamilyName f1 2023-02-14 11:01:57,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-14 11:01:57,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 00e3bb45fb92cf21cd462231c045ce74, server=jenkins-hbase4.apache.org,32997,1676372512284 in 262 msec 2023-02-14 11:01:57,089 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(310): Store=870c3c3f7c4b8d77f340ccc3e823e358/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,090 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:57,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 07b909a3cc6c112a938a75d0808c8089; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64548752, jitterRate=-0.03814864158630371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 07b909a3cc6c112a938a75d0808c8089: 2023-02-14 11:01:57,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089., pid=21, masterSystemTime=1676372516959 2023-02-14 11:01:57,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=00e3bb45fb92cf21cd462231c045ce74, ASSIGN in 449 msec 2023-02-14 11:01:57,092 DEBUG [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2 2023-02-14 11:01:57,092 DEBUG [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2 2023-02-14 11:01:57,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:01:57,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:01:57,093 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870c3c3f7c4b8d77f340ccc3e823e358 columnFamilyName f2 2023-02-14 11:01:57,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:57,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e6fdfdc4338b690965517d43ed5fb869, NAME => 'testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-14 11:01:57,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:57,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:57,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:57,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:57,094 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(310): Store=870c3c3f7c4b8d77f340ccc3e823e358/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,096 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=07b909a3cc6c112a938a75d0808c8089, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:57,096 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372517095"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517095"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517095"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517095"}]},"ts":"1676372517095"} 2023-02-14 11:01:57,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:57,097 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:57,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:57,101 DEBUG [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1 2023-02-14 11:01:57,101 DEBUG [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1 2023-02-14 11:01:57,102 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6fdfdc4338b690965517d43ed5fb869 columnFamilyName f1 2023-02-14 11:01:57,103 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(310): Store=e6fdfdc4338b690965517d43ed5fb869/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,103 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:57,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-14 11:01:57,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 07b909a3cc6c112a938a75d0808c8089, server=jenkins-hbase4.apache.org,36959,1676372512234 in 295 msec 2023-02-14 11:01:57,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:57,105 DEBUG [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2 2023-02-14 11:01:57,105 DEBUG [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2 2023-02-14 11:01:57,106 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6fdfdc4338b690965517d43ed5fb869 columnFamilyName f2 2023-02-14 11:01:57,106 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=07b909a3cc6c112a938a75d0808c8089, ASSIGN in 464 msec 2023-02-14 11:01:57,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:01:57,109 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(310): Store=e6fdfdc4338b690965517d43ed5fb869/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:57,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:57,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 870c3c3f7c4b8d77f340ccc3e823e358; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63735010, jitterRate=-0.05027434229850769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 870c3c3f7c4b8d77f340ccc3e823e358: 2023-02-14 11:01:57,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358., pid=26, masterSystemTime=1676372516975 2023-02-14 11:01:57,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:57,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:01:57,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:01:57,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:01:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ee0a8ce2f518cad240d966e483a534f3, NAME => 'testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-14 11:01:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:01:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:57,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:57,119 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=870c3c3f7c4b8d77f340ccc3e823e358, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:57,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372517119"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517119"}]},"ts":"1676372517119"} 2023-02-14 11:01:57,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-14 11:01:57,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 870c3c3f7c4b8d77f340ccc3e823e358, server=jenkins-hbase4.apache.org,32997,1676372512284 in 306 msec 2023-02-14 11:01:57,127 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:57,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=870c3c3f7c4b8d77f340ccc3e823e358, ASSIGN in 486 msec 2023-02-14 11:01:57,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,134 DEBUG [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1 2023-02-14 11:01:57,134 DEBUG [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1 2023-02-14 11:01:57,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e6fdfdc4338b690965517d43ed5fb869; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61551407, jitterRate=-0.08281256258487701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e6fdfdc4338b690965517d43ed5fb869: 2023-02-14 11:01:57,134 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee0a8ce2f518cad240d966e483a534f3 columnFamilyName f1 2023-02-14 11:01:57,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869., pid=25, masterSystemTime=1676372516959 2023-02-14 11:01:57,135 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(310): Store=ee0a8ce2f518cad240d966e483a534f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,136 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:57,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:57,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:57,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:01:57,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f18bb77a83aa40a46a7792e3ddbc6b43, NAME => 'testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-14 11:01:57,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:57,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:57,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:57,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:57,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e6fdfdc4338b690965517d43ed5fb869, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:57,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372517139"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517139"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517139"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517139"}]},"ts":"1676372517139"} 2023-02-14 11:01:57,140 DEBUG [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2 2023-02-14 11:01:57,140 DEBUG [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2 2023-02-14 11:01:57,141 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee0a8ce2f518cad240d966e483a534f3 columnFamilyName f2 2023-02-14 11:01:57,142 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(310): Store=ee0a8ce2f518cad240d966e483a534f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-14 11:01:57,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure e6fdfdc4338b690965517d43ed5fb869, server=jenkins-hbase4.apache.org,36959,1676372512234 in 328 msec 2023-02-14 11:01:57,149 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:57,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:57,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e6fdfdc4338b690965517d43ed5fb869, ASSIGN in 506 msec 2023-02-14 11:01:57,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:57,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:57,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:01:57,158 DEBUG [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1 2023-02-14 11:01:57,159 DEBUG [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1 2023-02-14 11:01:57,159 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f18bb77a83aa40a46a7792e3ddbc6b43 columnFamilyName f1 2023-02-14 11:01:57,160 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(310): Store=f18bb77a83aa40a46a7792e3ddbc6b43/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,160 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:57,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,162 DEBUG [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2 2023-02-14 11:01:57,162 DEBUG [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2 2023-02-14 11:01:57,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ee0a8ce2f518cad240d966e483a534f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67075399, jitterRate=-4.986673593521118E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ee0a8ce2f518cad240d966e483a534f3: 2023-02-14 11:01:57,163 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f18bb77a83aa40a46a7792e3ddbc6b43 columnFamilyName f2 2023-02-14 11:01:57,164 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(310): Store=f18bb77a83aa40a46a7792e3ddbc6b43/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3., pid=29, masterSystemTime=1676372516975 2023-02-14 11:01:57,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:57,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:57,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:01:57,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:01:57,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:57,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ac8776cda2c24f5cd82df312d2074d1b, NAME => 'testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-14 11:01:57,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:57,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:01:57,168 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ee0a8ce2f518cad240d966e483a534f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:57,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:57,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:57,168 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372517168"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517168"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517168"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517168"}]},"ts":"1676372517168"} 2023-02-14 11:01:57,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:57,171 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:57,173 DEBUG [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1 2023-02-14 11:01:57,173 DEBUG [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1 2023-02-14 11:01:57,174 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac8776cda2c24f5cd82df312d2074d1b columnFamilyName f1 2023-02-14 11:01:57,174 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(310): Store=ac8776cda2c24f5cd82df312d2074d1b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,174 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:57,176 DEBUG [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2 2023-02-14 11:01:57,176 DEBUG [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2 2023-02-14 11:01:57,177 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac8776cda2c24f5cd82df312d2074d1b columnFamilyName f2 2023-02-14 11:01:57,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:01:57,178 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(310): Store=ac8776cda2c24f5cd82df312d2074d1b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:01:57,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-14 11:01:57,181 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure ee0a8ce2f518cad240d966e483a534f3, server=jenkins-hbase4.apache.org,32997,1676372512284 in 337 msec 2023-02-14 11:01:57,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:57,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:57,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ee0a8ce2f518cad240d966e483a534f3, ASSIGN in 541 msec 2023-02-14 11:01:57,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f18bb77a83aa40a46a7792e3ddbc6b43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67238862, jitterRate=0.0019371211528778076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f18bb77a83aa40a46a7792e3ddbc6b43: 2023-02-14 11:01:57,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43., pid=23, masterSystemTime=1676372516959 2023-02-14 11:01:57,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:01:57,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:01:57,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:01:57,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ac8776cda2c24f5cd82df312d2074d1b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62138885, jitterRate=-0.07405845820903778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:01:57,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ac8776cda2c24f5cd82df312d2074d1b: 2023-02-14 11:01:57,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:01:57,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:01:57,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b., pid=30, masterSystemTime=1676372516975 2023-02-14 11:01:57,196 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=f18bb77a83aa40a46a7792e3ddbc6b43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:57,197 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372517196"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517196"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517196"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517196"}]},"ts":"1676372517196"} 2023-02-14 11:01:57,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:57,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:57,198 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ac8776cda2c24f5cd82df312d2074d1b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:57,198 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372517198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372517198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372517198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372517198"}]},"ts":"1676372517198"} 2023-02-14 11:01:57,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-14 11:01:57,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure f18bb77a83aa40a46a7792e3ddbc6b43, server=jenkins-hbase4.apache.org,36959,1676372512234 in 399 msec 2023-02-14 11:01:57,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=12 2023-02-14 11:01:57,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=12, state=SUCCESS; OpenRegionProcedure ac8776cda2c24f5cd82df312d2074d1b, server=jenkins-hbase4.apache.org,32997,1676372512284 in 373 msec 2023-02-14 11:01:57,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f18bb77a83aa40a46a7792e3ddbc6b43, ASSIGN in 574 msec 2023-02-14 11:01:57,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-14 11:01:57,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ac8776cda2c24f5cd82df312d2074d1b, ASSIGN in 577 msec 2023-02-14 11:01:57,221 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:01:57,221 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372517221"}]},"ts":"1676372517221"} 2023-02-14 11:01:57,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-14 11:01:57,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:01:57,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 871 msec 2023-02-14 11:01:57,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:01:57,500 INFO [Listener at localhost/43295] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-14 11:01:57,501 DEBUG [Listener at localhost/43295] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-14 11:01:57,502 INFO [Listener at localhost/43295] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:01:57,510 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-14 11:01:57,511 INFO [Listener at localhost/43295] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:01:57,511 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-14 11:01:57,511 INFO [Listener at localhost/43295] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-14 11:01:57,651 DEBUG [hconnection-0x3b13242f-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:01:57,725 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40576, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:01:57,767 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36959] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:57,771 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:58,064 INFO [Listener at localhost/43295] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-14 11:01:58,069 INFO [Listener at localhost/43295] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-14 11:01:58,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-14 11:01:58,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676372518083 (current time:1676372518083). 2023-02-14 11:01:58,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-14 11:01:58,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] zookeeper.ReadOnlyZKClient(139): Connect 0x01055c89 to 127.0.0.1:52840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:01:58,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62004ca9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:01:58,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:01:58,114 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45594, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:01:58,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01055c89 to 127.0.0.1:52840 2023-02-14 11:01:58,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:01:58,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-14 11:01:58,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-14 11:01:58,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-14 11:01:58,146 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-14 11:01:58,147 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676373118147 2023-02-14 11:01:58,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-14 11:01:58,149 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-14 11:01:58,151 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-14 11:01:58,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-14 11:01:58,156 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-14 11:01:58,156 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-14 11:01:58,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 16 msec 2023-02-14 11:01:58,157 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-14 11:01:58,158 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676373118158 2023-02-14 11:01:58,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-14 11:01:58,191 INFO [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-14 11:01:58,192 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:01:58,192 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-14 11:01:58,192 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-14 11:01:58,221 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:58,221 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-14 11:01:58,224 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:01:58,224 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:58,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:01:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:01:58,225 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:58,225 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:58,224 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:01:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-14 11:01:58,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:01:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:01:58,225 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:58,226 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:01:58,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:58,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-14 11:01:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-14 11:01:58,227 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-14 11:01:58,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-14 11:01:58,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:58,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-14 11:01:58,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-14 11:01:58,232 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-14 11:01:58,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-14 11:01:58,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-14 11:01:58,256 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:01:58,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:01:58,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:01:58,262 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-14 11:01:58,274 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-14 11:01:58,274 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:01:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-14 11:01:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-14 11:01:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:01:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-14 11:01:58,291 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-14 11:01:58,291 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-14 11:01:58,291 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36959,1676372512234' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-14 11:01:58,291 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32997,1676372512284' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-14 11:01:58,295 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,295 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:58,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:58,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:01:58,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:01:58,295 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,296 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:01:58,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:01:58,297 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:58,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:01:58,297 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-14 11:01:58,298 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,298 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:01:58,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:01:58,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36959,1676372512234' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-14 11:01:58,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53418ef7[Count = 1] remaining members to acquire global barrier 2023-02-14 11:01:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:01:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:01:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:01:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:01:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-14 11:01:58,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:58,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:58,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:01:58,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32997,1676372512284' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-14 11:01:58,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53418ef7[Count = 0] remaining members to acquire global barrier 2023-02-14 11:01:58,303 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-14 11:01:58,303 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,307 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,307 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:58,308 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:58,308 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-14 11:01:58,308 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-14 11:01:58,308 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:58,308 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:01:58,324 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:01:58,324 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. started... 2023-02-14 11:01:58,329 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:01:58,329 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. started... 2023-02-14 11:01:58,329 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:01:58,330 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:01:58,330 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. started... 2023-02-14 11:01:58,330 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:01:58,331 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:01:58,331 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. started... 2023-02-14 11:01:58,331 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c62d1c15ab4f6af58bd8dfd676f41e79 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:01:58,330 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-14 11:01:58,331 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 07b909a3cc6c112a938a75d0808c8089 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:01:58,330 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-14 11:01:58,332 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:01:58,330 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. started... 2023-02-14 11:01:58,331 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:01:58,331 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. started... 2023-02-14 11:01:58,332 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 870c3c3f7c4b8d77f340ccc3e823e358 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:01:58,333 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ee0a8ce2f518cad240d966e483a534f3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:01:58,333 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fd7a77d12080711034a1c568af3d5c0b: 2023-02-14 11:01:58,335 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,339 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 00e3bb45fb92cf21cd462231c045ce74: 2023-02-14 11:01:58,339 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,340 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,340 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,345 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:01:58,345 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:01:58,345 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:01:58,345 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:01:58,386 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. completed. 2023-02-14 11:01:58,386 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:01:58,390 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. completed. 2023-02-14 11:01:58,391 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:01:58,393 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-14 11:01:58,391 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:01:58,394 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:01:58,394 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-14 11:01:58,394 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. started... 2023-02-14 11:01:58,394 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. started... 2023-02-14 11:01:58,395 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f18bb77a83aa40a46a7792e3ddbc6b43 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:01:58,396 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 230a2c8fc9943a86304aff565048b090 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-14 11:01:58,462 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:01:58,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:01:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:01:58,465 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-14 11:01:58,544 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/.tmp/f1/f1331e5705ba443ea7996eb255092467 2023-02-14 11:01:58,551 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/.tmp/f1/fdfaccae205d48a2807780217ede46dd 2023-02-14 11:01:58,561 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/.tmp/f1/bc9a4e0b2d2f4094a49d6be26576c609 2023-02-14 11:01:58,578 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/.tmp/f1/62b4418fd1424893b0a1ded90ad484d3 2023-02-14 11:01:58,593 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/.tmp/f1/4bf3b7997b844bee957d3a5081bac179 2023-02-14 11:01:58,597 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/.tmp/f1/1d0166f7d03c4b859129a83373ca6fb1 2023-02-14 11:01:58,722 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/.tmp/f2/8c389a4d78b941549e6c62c2b1a5039e 2023-02-14 11:01:58,740 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/.tmp/f2/4b4d25cc03f94c499fcea984b27ca9f9 2023-02-14 11:01:58,741 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/.tmp/f2/80dedfb7c3b84a0cab47105b8373c743 2023-02-14 11:01:58,744 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/.tmp/f2/5b09719c201947f99fb57c9a8c5e8a51 2023-02-14 11:01:58,746 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/.tmp/f2/f0793b0e636945888c434ad90f4c5f57 2023-02-14 11:01:58,748 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/.tmp/f1/4bf3b7997b844bee957d3a5081bac179 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/4bf3b7997b844bee957d3a5081bac179 2023-02-14 11:01:58,752 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/.tmp/f2/1c00db0155fc4166ac5c8954a2f3bc98 2023-02-14 11:01:58,760 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/.tmp/f1/bc9a4e0b2d2f4094a49d6be26576c609 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/bc9a4e0b2d2f4094a49d6be26576c609 2023-02-14 11:01:58,761 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/.tmp/f1/1d0166f7d03c4b859129a83373ca6fb1 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/1d0166f7d03c4b859129a83373ca6fb1 2023-02-14 11:01:58,761 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/.tmp/f1/62b4418fd1424893b0a1ded90ad484d3 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/62b4418fd1424893b0a1ded90ad484d3 2023-02-14 11:01:58,764 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/.tmp/f1/f1331e5705ba443ea7996eb255092467 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/f1331e5705ba443ea7996eb255092467 2023-02-14 11:01:58,764 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/4bf3b7997b844bee957d3a5081bac179, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,765 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/.tmp/f1/fdfaccae205d48a2807780217ede46dd as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/fdfaccae205d48a2807780217ede46dd 2023-02-14 11:01:58,765 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:01:58,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:01:58,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:01:58,768 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-14 11:01:58,769 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/.tmp/f2/8c389a4d78b941549e6c62c2b1a5039e as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/8c389a4d78b941549e6c62c2b1a5039e 2023-02-14 11:01:58,774 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/bc9a4e0b2d2f4094a49d6be26576c609, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,778 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/.tmp/f2/5b09719c201947f99fb57c9a8c5e8a51 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/5b09719c201947f99fb57c9a8c5e8a51 2023-02-14 11:01:58,780 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/1d0166f7d03c4b859129a83373ca6fb1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,780 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/fdfaccae205d48a2807780217ede46dd, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:01:58,780 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/f1331e5705ba443ea7996eb255092467, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,781 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/62b4418fd1424893b0a1ded90ad484d3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,781 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/.tmp/f2/4b4d25cc03f94c499fcea984b27ca9f9 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/4b4d25cc03f94c499fcea984b27ca9f9 2023-02-14 11:01:58,782 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/.tmp/f2/80dedfb7c3b84a0cab47105b8373c743 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/80dedfb7c3b84a0cab47105b8373c743 2023-02-14 11:01:58,782 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/.tmp/f2/1c00db0155fc4166ac5c8954a2f3bc98 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/1c00db0155fc4166ac5c8954a2f3bc98 2023-02-14 11:01:58,782 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/.tmp/f2/f0793b0e636945888c434ad90f4c5f57 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/f0793b0e636945888c434ad90f4c5f57 2023-02-14 11:01:58,787 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/8c389a4d78b941549e6c62c2b1a5039e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,790 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ee0a8ce2f518cad240d966e483a534f3 in 457ms, sequenceid=5, compaction requested=false 2023-02-14 11:01:58,792 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/5b09719c201947f99fb57c9a8c5e8a51, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,792 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-14 11:01:58,793 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 870c3c3f7c4b8d77f340ccc3e823e358 in 461ms, sequenceid=5, compaction requested=false 2023-02-14 11:01:58,793 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-14 11:01:58,795 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/4b4d25cc03f94c499fcea984b27ca9f9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,795 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ee0a8ce2f518cad240d966e483a534f3: 2023-02-14 11:01:58,795 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/80dedfb7c3b84a0cab47105b8373c743, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,795 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,796 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,796 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/4bf3b7997b844bee957d3a5081bac179] hfiles 2023-02-14 11:01:58,796 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/4bf3b7997b844bee957d3a5081bac179 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,796 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c62d1c15ab4f6af58bd8dfd676f41e79 in 465ms, sequenceid=5, compaction requested=false 2023-02-14 11:01:58,796 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f18bb77a83aa40a46a7792e3ddbc6b43 in 401ms, sequenceid=5, compaction requested=false 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 870c3c3f7c4b8d77f340ccc3e823e358: 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f18bb77a83aa40a46a7792e3ddbc6b43: 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/bc9a4e0b2d2f4094a49d6be26576c609] hfiles 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c62d1c15ab4f6af58bd8dfd676f41e79: 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/8c389a4d78b941549e6c62c2b1a5039e] hfiles 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/bc9a4e0b2d2f4094a49d6be26576c609 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,802 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/5b09719c201947f99fb57c9a8c5e8a51] hfiles 2023-02-14 11:01:58,802 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/5b09719c201947f99fb57c9a8c5e8a51 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,802 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/f0793b0e636945888c434ad90f4c5f57, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,802 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,803 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,804 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/1d0166f7d03c4b859129a83373ca6fb1] hfiles 2023-02-14 11:01:58,804 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/1d0166f7d03c4b859129a83373ca6fb1 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,802 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/8c389a4d78b941549e6c62c2b1a5039e for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,804 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 07b909a3cc6c112a938a75d0808c8089 in 473ms, sequenceid=5, compaction requested=false 2023-02-14 11:01:58,801 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/62b4418fd1424893b0a1ded90ad484d3] hfiles 2023-02-14 11:01:58,804 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 07b909a3cc6c112a938a75d0808c8089: 2023-02-14 11:01:58,804 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/4b4d25cc03f94c499fcea984b27ca9f9] hfiles 2023-02-14 11:01:58,804 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/62b4418fd1424893b0a1ded90ad484d3 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,804 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,804 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/4b4d25cc03f94c499fcea984b27ca9f9 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,805 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,805 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/f1331e5705ba443ea7996eb255092467] hfiles 2023-02-14 11:01:58,805 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/f1331e5705ba443ea7996eb255092467 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,806 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/f0793b0e636945888c434ad90f4c5f57] hfiles 2023-02-14 11:01:58,806 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/f0793b0e636945888c434ad90f4c5f57 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,805 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/80dedfb7c3b84a0cab47105b8373c743] hfiles 2023-02-14 11:01:58,805 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/1c00db0155fc4166ac5c8954a2f3bc98, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:01:58,806 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/80dedfb7c3b84a0cab47105b8373c743 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,807 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 230a2c8fc9943a86304aff565048b090 in 411ms, sequenceid=5, compaction requested=false 2023-02-14 11:01:58,807 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 230a2c8fc9943a86304aff565048b090: 2023-02-14 11:01:58,807 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,807 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,807 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/fdfaccae205d48a2807780217ede46dd] hfiles 2023-02-14 11:01:58,807 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/fdfaccae205d48a2807780217ede46dd for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,807 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/1c00db0155fc4166ac5c8954a2f3bc98] hfiles 2023-02-14 11:01:58,808 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/1c00db0155fc4166ac5c8954a2f3bc98 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,862 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. completed. 2023-02-14 11:01:58,862 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:01:58,862 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:58,862 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-14 11:01:58,862 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. started... 2023-02-14 11:01:58,869 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. completed. 2023-02-14 11:01:58,869 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:01:58,869 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ac8776cda2c24f5cd82df312d2074d1b 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-14 11:01:58,870 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-14 11:01:58,890 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. completed. 2023-02-14 11:01:58,890 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:01:58,890 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:58,890 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-14 11:01:58,890 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. started... 2023-02-14 11:01:58,898 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e6fdfdc4338b690965517d43ed5fb869 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:01:58,899 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. completed. 2023-02-14 11:01:58,900 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:01:58,900 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-14 11:01:58,920 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/.tmp/f1/bfc2e3699b994110b6d496a49bc7a170 2023-02-14 11:01:58,924 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/.tmp/f1/719c7eca598048f59cc3b941142c44b5 2023-02-14 11:01:58,952 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/.tmp/f2/9ba9aff25ec244b586ccb356f2b5cda9 2023-02-14 11:01:58,955 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/.tmp/f2/2bb6d2737c894dc79e915918fdbcb94c 2023-02-14 11:01:58,961 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/.tmp/f1/bfc2e3699b994110b6d496a49bc7a170 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/bfc2e3699b994110b6d496a49bc7a170 2023-02-14 11:01:58,966 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/.tmp/f1/719c7eca598048f59cc3b941142c44b5 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/719c7eca598048f59cc3b941142c44b5 2023-02-14 11:01:58,969 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/bfc2e3699b994110b6d496a49bc7a170, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:01:58,970 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/.tmp/f2/9ba9aff25ec244b586ccb356f2b5cda9 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/9ba9aff25ec244b586ccb356f2b5cda9 2023-02-14 11:01:58,975 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/719c7eca598048f59cc3b941142c44b5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,976 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/.tmp/f2/2bb6d2737c894dc79e915918fdbcb94c as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/2bb6d2737c894dc79e915918fdbcb94c 2023-02-14 11:01:58,978 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/9ba9aff25ec244b586ccb356f2b5cda9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:01:58,980 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ac8776cda2c24f5cd82df312d2074d1b in 110ms, sequenceid=5, compaction requested=false 2023-02-14 11:01:58,980 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ac8776cda2c24f5cd82df312d2074d1b: 2023-02-14 11:01:58,980 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,980 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,980 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/bfc2e3699b994110b6d496a49bc7a170] hfiles 2023-02-14 11:01:58,980 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/bfc2e3699b994110b6d496a49bc7a170 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,980 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/9ba9aff25ec244b586ccb356f2b5cda9] hfiles 2023-02-14 11:01:58,980 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/9ba9aff25ec244b586ccb356f2b5cda9 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,985 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/2bb6d2737c894dc79e915918fdbcb94c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:01:58,986 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e6fdfdc4338b690965517d43ed5fb869 in 88ms, sequenceid=5, compaction requested=false 2023-02-14 11:01:58,986 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e6fdfdc4338b690965517d43ed5fb869: 2023-02-14 11:01:58,986 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,986 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:01:58,986 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/719c7eca598048f59cc3b941142c44b5] hfiles 2023-02-14 11:01:58,986 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/719c7eca598048f59cc3b941142c44b5 for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,986 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/2bb6d2737c894dc79e915918fdbcb94c] hfiles 2023-02-14 11:01:58,986 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/2bb6d2737c894dc79e915918fdbcb94c for snapshot=testWithMapReduceMultiRegion 2023-02-14 11:01:58,998 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. completed. 2023-02-14 11:01:58,999 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:01:58,999 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-14 11:01:58,999 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-14 11:01:58,999 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,000 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-14 11:01:59,000 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,32997,1676372512284' in zk 2023-02-14 11:01:59,004 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,004 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-14 11:01:59,004 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:01:59,004 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-14 11:01:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:01:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:01:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:01:59,006 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. completed. 2023-02-14 11:01:59,006 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:01:59,006 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-14 11:01:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:01:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-14 11:01:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:01:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-14 11:01:59,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,32997,1676372512284': 2023-02-14 11:01:59,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32997,1676372512284' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-14 11:01:59,268 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:01:59,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:01:59,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:01:59,270 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-14 11:01:59,300 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. completed. 2023-02-14 11:01:59,300 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:01:59,300 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-14 11:01:59,300 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. completed. 2023-02-14 11:01:59,300 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:01:59,301 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-14 11:01:59,301 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-14 11:01:59,301 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,301 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-14 11:01:59,301 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36959,1676372512234' in zk 2023-02-14 11:01:59,304 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-14 11:01:59,304 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,304 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:01:59,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,304 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-14 11:01:59,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:01:59,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:01:59,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:01:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:01:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-14 11:01:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:01:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-14 11:01:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36959,1676372512234': 2023-02-14 11:01:59,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36959,1676372512234' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-14 11:01:59,309 INFO [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-14 11:01:59,309 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:01:59,309 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:01:59,309 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-14 11:01:59,309 INFO [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-14 11:01:59,311 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,311 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,311 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:01:59,311 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:01:59,311 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:01:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:01:59,312 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:01:59,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:01:59,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:01:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:01:59,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:01:59,313 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-14 11:01:59,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:01:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-14 11:01:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,315 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,315 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:01:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-14 11:01:59,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,329 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,329 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:01:59,329 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:01:59,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:01:59,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:01:59,329 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-14 11:01:59,329 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-14 11:01:59,329 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:01:59,329 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-14 11:01:59,329 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:01:59,329 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:01:59,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:01:59,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:01:59,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:01:59,329 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-14 11:01:59,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:01:59,330 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:01:59,331 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:59,331 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:01:59,331 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-14 11:01:59,331 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-14 11:01:59,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:01:59,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:01:59,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-14 11:01:59,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-14 11:01:59,425 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-14 11:01:59,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-14 11:01:59,425 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-14 11:01:59,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676372518149Consolidate snapshot: testWithMapReduceMultiRegion at 1676372519329 (+1180 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676372519330 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676372519352 (+22 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676372519364 (+12 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676372519425 (+61 ms) 2023-02-14 11:01:59,427 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-14 11:01:59,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2760 sec 2023-02-14 11:02:00,270 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:00,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:02:00,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-14 11:02:00,273 INFO [Listener at localhost/43295] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-14 11:02:00,286 INFO [Listener at localhost/43295] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-14 11:02:00,301 INFO [Listener at localhost/43295] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-14 11:02:00,367 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36959] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:00,375 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:00,527 INFO [Listener at localhost/43295] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-14 11:02:00,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-14 11:02:00,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-14 11:02:00,552 INFO [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-14 11:02:00,552 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:00,553 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-14 11:02:00,553 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-14 11:02:00,553 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,554 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:00,556 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:00,556 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:00,556 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:00,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:00,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:00,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:00,556 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,556 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:00,557 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,557 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:00,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:00,558 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-14 11:02:00,558 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-14 11:02:00,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-14 11:02:00,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-14 11:02:00,562 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-14 11:02:00,562 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:00,564 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-14 11:02:00,565 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-14 11:02:00,565 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:00,565 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-14 11:02:00,566 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:00,566 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:00,566 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. started... 2023-02-14 11:02:00,566 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. started... 2023-02-14 11:02:00,567 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-14 11:02:00,567 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 00e3bb45fb92cf21cd462231c045ce74: 2023-02-14 11:02:00,567 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fd7a77d12080711034a1c568af3d5c0b: 2023-02-14 11:02:00,567 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:00,567 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:00,567 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:00,567 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:00,567 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. started... 2023-02-14 11:02:00,567 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:00,567 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. started... 2023-02-14 11:02:00,568 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ee0a8ce2f518cad240d966e483a534f3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:00,568 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 870c3c3f7c4b8d77f340ccc3e823e358 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:00,568 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:00,568 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. started... 2023-02-14 11:02:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-14 11:02:00,568 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 230a2c8fc9943a86304aff565048b090 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-14 11:02:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-14 11:02:00,569 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:00,569 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. started... 2023-02-14 11:02:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-14 11:02:00,569 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f18bb77a83aa40a46a7792e3ddbc6b43 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:00,569 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:00,569 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. started... 2023-02-14 11:02:00,572 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:00,572 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. started... 2023-02-14 11:02:00,573 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 07b909a3cc6c112a938a75d0808c8089 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:00,575 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c62d1c15ab4f6af58bd8dfd676f41e79 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:00,619 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-14 11:02:00,660 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/.tmp/f1/35f27fbb42b540d0beff6f1ac02aa9cf 2023-02-14 11:02:00,660 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/.tmp/f1/c839b2aa3fd94486b6a029fbcc6c3452 2023-02-14 11:02:00,670 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/.tmp/f1/fa9798c60e6b499d99d3d4c78d29d84e 2023-02-14 11:02:00,676 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/.tmp/f1/0a7a54dffa184aaaa1db72d64f9077fa 2023-02-14 11:02:00,684 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/.tmp/f1/f8f9576231e345b4a82f775ff986b9d2 2023-02-14 11:02:00,686 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/.tmp/f1/b39cf6b6072b4418a8fe211e2bd9a4f3 2023-02-14 11:02:00,717 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/.tmp/f2/fd182cc444784418a2cdceb0c1beafd3 2023-02-14 11:02:00,730 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/.tmp/f2/c9d3f0a7cb11483480fa702485bb139b 2023-02-14 11:02:00,736 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/.tmp/f1/c839b2aa3fd94486b6a029fbcc6c3452 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/c839b2aa3fd94486b6a029fbcc6c3452 2023-02-14 11:02:00,741 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/.tmp/f1/35f27fbb42b540d0beff6f1ac02aa9cf as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/35f27fbb42b540d0beff6f1ac02aa9cf 2023-02-14 11:02:00,743 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-14 11:02:00,744 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-14 11:02:00,744 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/.tmp/f2/74231a43ca364a6c95bd675f65dc7c50 2023-02-14 11:02:00,745 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/.tmp/f2/2fe5e2859e564d5fa91664a258fa23f6 2023-02-14 11:02:00,746 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/.tmp/f2/f778ce0d86c24ade98a903468e1b24e5 2023-02-14 11:02:00,748 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/c839b2aa3fd94486b6a029fbcc6c3452, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,750 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/.tmp/f2/fd182cc444784418a2cdceb0c1beafd3 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/fd182cc444784418a2cdceb0c1beafd3 2023-02-14 11:02:00,752 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/35f27fbb42b540d0beff6f1ac02aa9cf, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,755 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/.tmp/f1/0a7a54dffa184aaaa1db72d64f9077fa as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/0a7a54dffa184aaaa1db72d64f9077fa 2023-02-14 11:02:00,757 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/.tmp/f2/c9d3f0a7cb11483480fa702485bb139b as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/c9d3f0a7cb11483480fa702485bb139b 2023-02-14 11:02:00,760 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/.tmp/f1/f8f9576231e345b4a82f775ff986b9d2 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/f8f9576231e345b4a82f775ff986b9d2 2023-02-14 11:02:00,761 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/.tmp/f2/e8b3c0d3383d40de98574b3d32f93b87 2023-02-14 11:02:00,763 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/.tmp/f1/fa9798c60e6b499d99d3d4c78d29d84e as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/fa9798c60e6b499d99d3d4c78d29d84e 2023-02-14 11:02:00,768 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/c9d3f0a7cb11483480fa702485bb139b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,769 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/0a7a54dffa184aaaa1db72d64f9077fa, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,770 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 07b909a3cc6c112a938a75d0808c8089 in 197ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:00,770 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 07b909a3cc6c112a938a75d0808c8089: 2023-02-14 11:02:00,770 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:00,772 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/.tmp/f2/f778ce0d86c24ade98a903468e1b24e5 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/f778ce0d86c24ade98a903468e1b24e5 2023-02-14 11:02:00,772 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:00,772 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-14 11:02:00,772 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. started... 2023-02-14 11:02:00,772 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e6fdfdc4338b690965517d43ed5fb869 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:00,774 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/fd182cc444784418a2cdceb0c1beafd3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,775 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 870c3c3f7c4b8d77f340ccc3e823e358 in 207ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:00,775 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 870c3c3f7c4b8d77f340ccc3e823e358: 2023-02-14 11:02:00,775 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:00,775 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:00,775 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. started... 2023-02-14 11:02:00,775 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-14 11:02:00,775 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ac8776cda2c24f5cd82df312d2074d1b 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-14 11:02:00,784 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/f778ce0d86c24ade98a903468e1b24e5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,785 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/fa9798c60e6b499d99d3d4c78d29d84e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,785 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/.tmp/f1/b39cf6b6072b4418a8fe211e2bd9a4f3 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/b39cf6b6072b4418a8fe211e2bd9a4f3 2023-02-14 11:02:00,786 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/.tmp/f2/74231a43ca364a6c95bd675f65dc7c50 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/74231a43ca364a6c95bd675f65dc7c50 2023-02-14 11:02:00,789 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ee0a8ce2f518cad240d966e483a534f3 in 221ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:00,789 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ee0a8ce2f518cad240d966e483a534f3: 2023-02-14 11:02:00,789 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-14 11:02:00,829 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/b39cf6b6072b4418a8fe211e2bd9a4f3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:00,829 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/74231a43ca364a6c95bd675f65dc7c50, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,830 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/f8f9576231e345b4a82f775ff986b9d2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,832 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f18bb77a83aa40a46a7792e3ddbc6b43 in 262ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:00,832 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/.tmp/f2/e8b3c0d3383d40de98574b3d32f93b87 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/e8b3c0d3383d40de98574b3d32f93b87 2023-02-14 11:02:00,832 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/.tmp/f2/2fe5e2859e564d5fa91664a258fa23f6 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/2fe5e2859e564d5fa91664a258fa23f6 2023-02-14 11:02:00,832 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f18bb77a83aa40a46a7792e3ddbc6b43: 2023-02-14 11:02:00,832 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:00,832 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-14 11:02:00,840 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/.tmp/f1/6b2f77300ed94c77a693314a0b6991cc 2023-02-14 11:02:00,843 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/e8b3c0d3383d40de98574b3d32f93b87, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:00,845 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 230a2c8fc9943a86304aff565048b090 in 276ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:00,845 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 230a2c8fc9943a86304aff565048b090: 2023-02-14 11:02:00,845 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:00,845 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-14 11:02:00,845 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/.tmp/f1/db7b2e72f0c44aeca2cecb3f42f241c8 2023-02-14 11:02:00,851 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/2fe5e2859e564d5fa91664a258fa23f6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,853 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c62d1c15ab4f6af58bd8dfd676f41e79 in 278ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:00,853 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c62d1c15ab4f6af58bd8dfd676f41e79: 2023-02-14 11:02:00,853 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:00,853 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-14 11:02:00,876 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/.tmp/f2/7e3f808ea10545ce9880db3ea565c39b 2023-02-14 11:02:00,878 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/.tmp/f2/bb5c162e50824772967cbf3727686a86 2023-02-14 11:02:00,885 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/.tmp/f1/db7b2e72f0c44aeca2cecb3f42f241c8 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/db7b2e72f0c44aeca2cecb3f42f241c8 2023-02-14 11:02:00,886 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/.tmp/f1/6b2f77300ed94c77a693314a0b6991cc as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/6b2f77300ed94c77a693314a0b6991cc 2023-02-14 11:02:00,891 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/db7b2e72f0c44aeca2cecb3f42f241c8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,892 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/.tmp/f2/7e3f808ea10545ce9880db3ea565c39b as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/7e3f808ea10545ce9880db3ea565c39b 2023-02-14 11:02:00,895 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/6b2f77300ed94c77a693314a0b6991cc, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:00,895 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/.tmp/f2/bb5c162e50824772967cbf3727686a86 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/bb5c162e50824772967cbf3727686a86 2023-02-14 11:02:00,906 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/7e3f808ea10545ce9880db3ea565c39b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:00,907 INFO [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e6fdfdc4338b690965517d43ed5fb869 in 135ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:00,907 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e6fdfdc4338b690965517d43ed5fb869: 2023-02-14 11:02:00,907 DEBUG [rs(jenkins-hbase4.apache.org,36959,1676372512234)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:00,907 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-14 11:02:00,907 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-14 11:02:00,907 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,908 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-14 11:02:00,908 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36959,1676372512234' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-14 11:02:00,910 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/bb5c162e50824772967cbf3727686a86, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:00,910 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:00,911 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:00,911 INFO [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ac8776cda2c24f5cd82df312d2074d1b in 136ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:00,911 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,911 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ac8776cda2c24f5cd82df312d2074d1b: 2023-02-14 11:02:00,911 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:00,911 DEBUG [rs(jenkins-hbase4.apache.org,32997,1676372512284)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:00,912 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-14 11:02:00,912 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-14 11:02:00,912 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,912 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-14 11:02:00,912 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32997,1676372512284' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-14 11:02:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,913 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,914 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:00,914 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36959,1676372512234' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-14 11:02:00,914 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75fac1ea[Count = 1] remaining members to acquire global barrier 2023-02-14 11:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:00,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32997,1676372512284' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-14 11:02:00,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75fac1ea[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:00,917 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-14 11:02:00,917 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,919 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,919 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,920 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-14 11:02:00,920 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-14 11:02:00,920 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,920 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-14 11:02:00,920 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-14 11:02:00,920 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36959,1676372512234' in zk 2023-02-14 11:02:00,920 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,32997,1676372512284' in zk 2023-02-14 11:02:00,920 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,920 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:00,923 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-14 11:02:00,923 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,923 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:00,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:00,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:00,923 DEBUG [member: 'jenkins-hbase4.apache.org,36959,1676372512234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-14 11:02:00,924 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-14 11:02:00,924 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:00,924 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,924 DEBUG [member: 'jenkins-hbase4.apache.org,32997,1676372512284' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-14 11:02:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:00,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:00,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:00,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:00,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,36959,1676372512234': 2023-02-14 11:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36959,1676372512234' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-14 11:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:00,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:00,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,32997,1676372512284': 2023-02-14 11:02:00,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32997,1676372512284' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-14 11:02:00,932 INFO [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-14 11:02:00,932 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:00,932 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:00,932 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-14 11:02:00,932 INFO [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-14 11:02:00,935 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,935 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,935 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:00,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,935 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,935 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:00,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,935 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:00,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:00,936 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:00,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:00,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:00,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,938 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:00,939 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:00,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,944 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,944 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:00,944 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:00,944 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:00,945 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,945 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:00,945 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:00,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:00,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:00,945 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:00,945 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:00,945 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,945 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:00,945 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:00,945 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:00,945 DEBUG [(jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:00,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-14 11:02:00,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-14 11:02:00,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:00,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:00,948 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:00,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:00,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:00,948 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-14 11:02:01,049 DEBUG [Listener at localhost/43295] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-14 11:02:01,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-14 11:02:01,152 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop-8134918698767110315.jar 2023-02-14 11:02:01,168 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676372518083 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:01,169 DEBUG [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: 230a2c8fc9943a86304aff565048b090 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(239): region to add: ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:02:01,170 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=00e3bb45fb92cf21cd462231c045ce74 as 00e3bb45fb92cf21cd462231c045ce74 in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,171 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=870c3c3f7c4b8d77f340ccc3e823e358 as 870c3c3f7c4b8d77f340ccc3e823e358 in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,171 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=ee0a8ce2f518cad240d966e483a534f3 as ee0a8ce2f518cad240d966e483a534f3 in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,171 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=fd7a77d12080711034a1c568af3d5c0b as fd7a77d12080711034a1c568af3d5c0b in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,171 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=c62d1c15ab4f6af58bd8dfd676f41e79 as c62d1c15ab4f6af58bd8dfd676f41e79 in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,171 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=230a2c8fc9943a86304aff565048b090 as 230a2c8fc9943a86304aff565048b090 in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,171 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=07b909a3cc6c112a938a75d0808c8089 as 07b909a3cc6c112a938a75d0808c8089 in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,171 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=f18bb77a83aa40a46a7792e3ddbc6b43 as f18bb77a83aa40a46a7792e3ddbc6b43 in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,171 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=e6fdfdc4338b690965517d43ed5fb869 as e6fdfdc4338b690965517d43ed5fb869 in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,171 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(585): clone region=ac8776cda2c24f5cd82df312d2074d1b as ac8776cda2c24f5cd82df312d2074d1b in snapshot testWithMapReduceMultiRegion 2023-02-14 11:02:01,174 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 00e3bb45fb92cf21cd462231c045ce74, NAME => 'testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,174 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 230a2c8fc9943a86304aff565048b090, NAME => 'testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,175 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => ee0a8ce2f518cad240d966e483a534f3, NAME => 'testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,175 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 870c3c3f7c4b8d77f340ccc3e823e358, NAME => 'testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,175 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => c62d1c15ab4f6af58bd8dfd676f41e79, NAME => 'testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,175 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 07b909a3cc6c112a938a75d0808c8089, NAME => 'testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,176 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => f18bb77a83aa40a46a7792e3ddbc6b43, NAME => 'testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,176 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => fd7a77d12080711034a1c568af3d5c0b, NAME => 'testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,177 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:01,178 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-14 11:02:01,205 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,205 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,205 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 00e3bb45fb92cf21cd462231c045ce74, disabling compactions & flushes 2023-02-14 11:02:01,205 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1d0166f7d03c4b859129a83373ca6fb1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,205 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:01,206 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:01,206 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. after waiting 0 ms 2023-02-14 11:02:01,206 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:01,206 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:01,206 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 00e3bb45fb92cf21cd462231c045ce74: 2023-02-14 11:02:01,206 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e6fdfdc4338b690965517d43ed5fb869, NAME => 'testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,215 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4b4d25cc03f94c499fcea984b27ca9f9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,216 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,216 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bc9a4e0b2d2f4094a49d6be26576c609 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,217 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,217 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fdfaccae205d48a2807780217ede46dd from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,223 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing c62d1c15ab4f6af58bd8dfd676f41e79, disabling compactions & flushes 2023-02-14 11:02:01,223 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:01,223 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:01,223 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. after waiting 0 ms 2023-02-14 11:02:01,223 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:01,223 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:01,223 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for c62d1c15ab4f6af58bd8dfd676f41e79: 2023-02-14 11:02:01,224 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ac8776cda2c24f5cd82df312d2074d1b, NAME => 'testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,224 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,224 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4bf3b7997b844bee957d3a5081bac179 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,229 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1c00db0155fc4166ac5c8954a2f3bc98 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,229 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,229 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing fd7a77d12080711034a1c568af3d5c0b, disabling compactions & flushes 2023-02-14 11:02:01,229 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:01,229 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5b09719c201947f99fb57c9a8c5e8a51 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,229 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:01,230 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. after waiting 0 ms 2023-02-14 11:02:01,230 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:01,230 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:01,230 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for fd7a77d12080711034a1c568af3d5c0b: 2023-02-14 11:02:01,236 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8c389a4d78b941549e6c62c2b1a5039e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,240 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,241 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing ee0a8ce2f518cad240d966e483a534f3, disabling compactions & flushes 2023-02-14 11:02:01,241 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f1331e5705ba443ea7996eb255092467 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,241 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:01,241 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:01,241 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. after waiting 0 ms 2023-02-14 11:02:01,241 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:01,241 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:01,241 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for ee0a8ce2f518cad240d966e483a534f3: 2023-02-14 11:02:01,244 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,245 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 62b4418fd1424893b0a1ded90ad484d3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 230a2c8fc9943a86304aff565048b090, disabling compactions & flushes 2023-02-14 11:02:01,248 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:01,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:01,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. after waiting 0 ms 2023-02-14 11:02:01,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:01,248 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:01,249 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 230a2c8fc9943a86304aff565048b090: 2023-02-14 11:02:01,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 870c3c3f7c4b8d77f340ccc3e823e358, disabling compactions & flushes 2023-02-14 11:02:01,249 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:01,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:01,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. after waiting 0 ms 2023-02-14 11:02:01,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:01,249 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:01,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 870c3c3f7c4b8d77f340ccc3e823e358: 2023-02-14 11:02:01,249 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f0793b0e636945888c434ad90f4c5f57 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,251 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 80dedfb7c3b84a0cab47105b8373c743 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,259 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,260 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 719c7eca598048f59cc3b941142c44b5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,260 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:01,260 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 07b909a3cc6c112a938a75d0808c8089, disabling compactions & flushes 2023-02-14 11:02:01,260 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bfc2e3699b994110b6d496a49bc7a170 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,260 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:01,260 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:01,260 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. after waiting 0 ms 2023-02-14 11:02:01,260 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:01,260 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:01,260 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 07b909a3cc6c112a938a75d0808c8089: 2023-02-14 11:02:01,261 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing f18bb77a83aa40a46a7792e3ddbc6b43, disabling compactions & flushes 2023-02-14 11:02:01,261 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:01,261 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:01,261 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. after waiting 0 ms 2023-02-14 11:02:01,261 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:01,261 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:01,261 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for f18bb77a83aa40a46a7792e3ddbc6b43: 2023-02-14 11:02:01,263 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2bb6d2737c894dc79e915918fdbcb94c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,263 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ba9aff25ec244b586ccb356f2b5cda9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e6fdfdc4338b690965517d43ed5fb869, disabling compactions & flushes 2023-02-14 11:02:01,266 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ac8776cda2c24f5cd82df312d2074d1b, disabling compactions & flushes 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. after waiting 0 ms 2023-02-14 11:02:01,266 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:01,266 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. after waiting 0 ms 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e6fdfdc4338b690965517d43ed5fb869: 2023-02-14 11:02:01,266 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:01,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ac8776cda2c24f5cd82df312d2074d1b: 2023-02-14 11:02:01,267 INFO [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676372518083 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:01,267 DEBUG [Listener at localhost/43295] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,267 DEBUG [Listener at localhost/43295] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd 2023-02-14 11:02:01,268 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-data/ 2023-02-14 11:02:01,268 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----default/ 2023-02-14 11:02:01,269 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-14 11:02:01,269 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------00e3bb45fb92cf21cd462231c045ce74/ 2023-02-14 11:02:01,270 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,270 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------07b909a3cc6c112a938a75d0808c8089/ 2023-02-14 11:02:01,270 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,271 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:01,271 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=07b909a3cc6c112a938a75d0808c8089-f1331e5705ba443ea7996eb255092467 2023-02-14 11:02:01,271 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:01,271 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=07b909a3cc6c112a938a75d0808c8089-f0793b0e636945888c434ad90f4c5f57 2023-02-14 11:02:01,271 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------230a2c8fc9943a86304aff565048b090/ 2023-02-14 11:02:01,272 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,272 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:01,273 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=230a2c8fc9943a86304aff565048b090-fdfaccae205d48a2807780217ede46dd 2023-02-14 11:02:01,273 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:01,273 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=230a2c8fc9943a86304aff565048b090-1c00db0155fc4166ac5c8954a2f3bc98 2023-02-14 11:02:01,273 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------870c3c3f7c4b8d77f340ccc3e823e358/ 2023-02-14 11:02:01,274 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,274 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:01,274 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=870c3c3f7c4b8d77f340ccc3e823e358-bc9a4e0b2d2f4094a49d6be26576c609 2023-02-14 11:02:01,274 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:01,275 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=870c3c3f7c4b8d77f340ccc3e823e358-5b09719c201947f99fb57c9a8c5e8a51 2023-02-14 11:02:01,275 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------ac8776cda2c24f5cd82df312d2074d1b/ 2023-02-14 11:02:01,275 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,275 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:01,276 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=ac8776cda2c24f5cd82df312d2074d1b-bfc2e3699b994110b6d496a49bc7a170 2023-02-14 11:02:01,276 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:01,276 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=ac8776cda2c24f5cd82df312d2074d1b-9ba9aff25ec244b586ccb356f2b5cda9 2023-02-14 11:02:01,276 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------c62d1c15ab4f6af58bd8dfd676f41e79/ 2023-02-14 11:02:01,277 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,277 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:01,278 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=c62d1c15ab4f6af58bd8dfd676f41e79-1d0166f7d03c4b859129a83373ca6fb1 2023-02-14 11:02:01,278 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:01,278 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=c62d1c15ab4f6af58bd8dfd676f41e79-4b4d25cc03f94c499fcea984b27ca9f9 2023-02-14 11:02:01,278 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------e6fdfdc4338b690965517d43ed5fb869/ 2023-02-14 11:02:01,279 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,279 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:01,279 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=e6fdfdc4338b690965517d43ed5fb869-719c7eca598048f59cc3b941142c44b5 2023-02-14 11:02:01,279 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:01,280 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=e6fdfdc4338b690965517d43ed5fb869-2bb6d2737c894dc79e915918fdbcb94c 2023-02-14 11:02:01,280 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------ee0a8ce2f518cad240d966e483a534f3/ 2023-02-14 11:02:01,280 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,280 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:01,281 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=ee0a8ce2f518cad240d966e483a534f3-4bf3b7997b844bee957d3a5081bac179 2023-02-14 11:02:01,281 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:01,281 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=ee0a8ce2f518cad240d966e483a534f3-8c389a4d78b941549e6c62c2b1a5039e 2023-02-14 11:02:01,281 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------f18bb77a83aa40a46a7792e3ddbc6b43/ 2023-02-14 11:02:01,282 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,282 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:01,282 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=f18bb77a83aa40a46a7792e3ddbc6b43-62b4418fd1424893b0a1ded90ad484d3 2023-02-14 11:02:01,282 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:01,283 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |----------------testWithMapReduce=f18bb77a83aa40a46a7792e3ddbc6b43-80dedfb7c3b84a0cab47105b8373c743 2023-02-14 11:02:01,283 DEBUG [Listener at localhost/43295] util.CommonFSUtils(699): |----------fd7a77d12080711034a1c568af3d5c0b/ 2023-02-14 11:02:01,283 DEBUG [Listener at localhost/43295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:01,292 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:01,293 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:01,293 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:01,294 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,241 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop-2832078364687602539.jar 2023-02-14 11:02:02,242 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,242 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,316 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop-464792151829889334.jar 2023-02-14 11:02:02,316 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,317 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,317 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,318 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,318 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,319 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,320 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-14 11:02:02,320 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-14 11:02:02,321 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-14 11:02:02,322 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-14 11:02:02,322 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-14 11:02:02,323 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-14 11:02:02,324 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-14 11:02:02,324 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-14 11:02:02,325 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-14 11:02:02,326 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-14 11:02:02,332 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:02,333 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-14 11:02:02,333 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-14 11:02:02,334 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-14 11:02:02,334 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-14 11:02:02,405 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop-3662901721849675455.jar 2023-02-14 11:02:02,406 DEBUG [Listener at localhost/43295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-14 11:02:02,462 WARN [Listener at localhost/43295] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-14 11:02:02,477 WARN [Listener at localhost/43295] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-14 11:02:02,491 INFO [Listener at localhost/43295] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-14 11:02:02,920 WARN [Listener at localhost/43295] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/mapreduce.cluster.local.dir/1676372522833/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-14 11:02:02,920 WARN [Listener at localhost/43295] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/mapreduce.cluster.local.dir/1676372522833/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-14 11:02:03,078 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:03,079 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:03,082 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:03,085 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:02:03,087 DEBUG [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/f1 2023-02-14 11:02:03,087 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00e3bb45fb92cf21cd462231c045ce74 columnFamilyName f1 2023-02-14 11:02:03,088 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] regionserver.HStore(310): Store=00e3bb45fb92cf21cd462231c045ce74/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,088 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:02:03,091 DEBUG [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/f2 2023-02-14 11:02:03,091 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00e3bb45fb92cf21cd462231c045ce74 columnFamilyName f2 2023-02-14 11:02:03,092 INFO [StoreOpener-00e3bb45fb92cf21cd462231c045ce74-1] regionserver.HStore(310): Store=00e3bb45fb92cf21cd462231c045ce74/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:03,093 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 00e3bb45fb92cf21cd462231c045ce74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75120850, jitterRate=0.11938789486885071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:03,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 00e3bb45fb92cf21cd462231c045ce74: 2023-02-14 11:02:03,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 00e3bb45fb92cf21cd462231c045ce74, disabling compactions & flushes 2023-02-14 11:02:03,144 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:03,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:03,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. after waiting 0 ms 2023-02-14 11:02:03,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:03,145 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:03,145 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 00e3bb45fb92cf21cd462231c045ce74: 2023-02-14 11:02:03,163 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:03,163 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:03,176 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:03,179 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:02:03,181 DEBUG [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1 2023-02-14 11:02:03,181 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870c3c3f7c4b8d77f340ccc3e823e358 columnFamilyName f1 2023-02-14 11:02:03,201 DEBUG [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/testWithMapReduce=870c3c3f7c4b8d77f340ccc3e823e358-bc9a4e0b2d2f4094a49d6be26576c609 2023-02-14 11:02:03,202 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(310): Store=870c3c3f7c4b8d77f340ccc3e823e358/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,202 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:02:03,203 DEBUG [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2 2023-02-14 11:02:03,204 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870c3c3f7c4b8d77f340ccc3e823e358 columnFamilyName f2 2023-02-14 11:02:03,211 DEBUG [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/testWithMapReduce=870c3c3f7c4b8d77f340ccc3e823e358-5b09719c201947f99fb57c9a8c5e8a51 2023-02-14 11:02:03,211 INFO [StoreOpener-870c3c3f7c4b8d77f340ccc3e823e358-1] regionserver.HStore(310): Store=870c3c3f7c4b8d77f340ccc3e823e358/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,212 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:03,212 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 870c3c3f7c4b8d77f340ccc3e823e358; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63168890, jitterRate=-0.058710187673568726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:03,213 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 870c3c3f7c4b8d77f340ccc3e823e358: 2023-02-14 11:02:03,367 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 870c3c3f7c4b8d77f340ccc3e823e358, disabling compactions & flushes 2023-02-14 11:02:03,367 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:03,367 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:03,367 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. after waiting 0 ms 2023-02-14 11:02:03,368 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:03,376 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:03,376 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 870c3c3f7c4b8d77f340ccc3e823e358: 2023-02-14 11:02:03,383 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:03,383 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:03,384 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:03,387 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 230a2c8fc9943a86304aff565048b090 2023-02-14 11:02:03,388 DEBUG [StoreOpener-230a2c8fc9943a86304aff565048b090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1 2023-02-14 11:02:03,389 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 230a2c8fc9943a86304aff565048b090 columnFamilyName f1 2023-02-14 11:02:03,408 DEBUG [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/testWithMapReduce=230a2c8fc9943a86304aff565048b090-fdfaccae205d48a2807780217ede46dd 2023-02-14 11:02:03,409 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(310): Store=230a2c8fc9943a86304aff565048b090/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,409 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 230a2c8fc9943a86304aff565048b090 2023-02-14 11:02:03,410 DEBUG [StoreOpener-230a2c8fc9943a86304aff565048b090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2 2023-02-14 11:02:03,411 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 230a2c8fc9943a86304aff565048b090 columnFamilyName f2 2023-02-14 11:02:03,435 DEBUG [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/testWithMapReduce=230a2c8fc9943a86304aff565048b090-1c00db0155fc4166ac5c8954a2f3bc98 2023-02-14 11:02:03,435 INFO [StoreOpener-230a2c8fc9943a86304aff565048b090-1] regionserver.HStore(310): Store=230a2c8fc9943a86304aff565048b090/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,435 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:03,435 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 230a2c8fc9943a86304aff565048b090; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60582122, jitterRate=-0.09725603461265564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:03,436 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 230a2c8fc9943a86304aff565048b090: 2023-02-14 11:02:03,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 230a2c8fc9943a86304aff565048b090, disabling compactions & flushes 2023-02-14 11:02:03,534 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:03,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:03,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. after waiting 0 ms 2023-02-14 11:02:03,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:03,544 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:03,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 230a2c8fc9943a86304aff565048b090: 2023-02-14 11:02:03,557 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:03,557 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:03,564 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:03,567 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:02:03,568 DEBUG [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1 2023-02-14 11:02:03,569 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b909a3cc6c112a938a75d0808c8089 columnFamilyName f1 2023-02-14 11:02:03,578 DEBUG [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/testWithMapReduce=07b909a3cc6c112a938a75d0808c8089-f1331e5705ba443ea7996eb255092467 2023-02-14 11:02:03,578 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(310): Store=07b909a3cc6c112a938a75d0808c8089/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,578 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:02:03,580 DEBUG [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2 2023-02-14 11:02:03,580 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b909a3cc6c112a938a75d0808c8089 columnFamilyName f2 2023-02-14 11:02:03,596 DEBUG [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/testWithMapReduce=07b909a3cc6c112a938a75d0808c8089-f0793b0e636945888c434ad90f4c5f57 2023-02-14 11:02:03,597 INFO [StoreOpener-07b909a3cc6c112a938a75d0808c8089-1] regionserver.HStore(310): Store=07b909a3cc6c112a938a75d0808c8089/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,597 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:03,597 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 07b909a3cc6c112a938a75d0808c8089; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62327975, jitterRate=-0.07124079763889313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:03,597 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 07b909a3cc6c112a938a75d0808c8089: 2023-02-14 11:02:03,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 07b909a3cc6c112a938a75d0808c8089, disabling compactions & flushes 2023-02-14 11:02:03,653 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:03,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:03,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. after waiting 0 ms 2023-02-14 11:02:03,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:03,665 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:03,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 07b909a3cc6c112a938a75d0808c8089: 2023-02-14 11:02:03,670 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:03,671 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:03,680 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:03,683 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:02:03,684 DEBUG [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1 2023-02-14 11:02:03,685 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c62d1c15ab4f6af58bd8dfd676f41e79 columnFamilyName f1 2023-02-14 11:02:03,692 DEBUG [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/testWithMapReduce=c62d1c15ab4f6af58bd8dfd676f41e79-1d0166f7d03c4b859129a83373ca6fb1 2023-02-14 11:02:03,692 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(310): Store=c62d1c15ab4f6af58bd8dfd676f41e79/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,693 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:02:03,694 DEBUG [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2 2023-02-14 11:02:03,694 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c62d1c15ab4f6af58bd8dfd676f41e79 columnFamilyName f2 2023-02-14 11:02:03,701 DEBUG [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/testWithMapReduce=c62d1c15ab4f6af58bd8dfd676f41e79-4b4d25cc03f94c499fcea984b27ca9f9 2023-02-14 11:02:03,702 INFO [StoreOpener-c62d1c15ab4f6af58bd8dfd676f41e79-1] regionserver.HStore(310): Store=c62d1c15ab4f6af58bd8dfd676f41e79/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,702 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:03,702 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c62d1c15ab4f6af58bd8dfd676f41e79; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72387071, jitterRate=0.07865141332149506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:03,702 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c62d1c15ab4f6af58bd8dfd676f41e79: 2023-02-14 11:02:03,738 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c62d1c15ab4f6af58bd8dfd676f41e79, disabling compactions & flushes 2023-02-14 11:02:03,738 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:03,738 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:03,738 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. after waiting 0 ms 2023-02-14 11:02:03,738 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:03,748 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:03,748 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c62d1c15ab4f6af58bd8dfd676f41e79: 2023-02-14 11:02:03,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:03,754 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:03,755 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:03,761 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:02:03,762 DEBUG [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1 2023-02-14 11:02:03,763 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac8776cda2c24f5cd82df312d2074d1b columnFamilyName f1 2023-02-14 11:02:03,778 DEBUG [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/testWithMapReduce=ac8776cda2c24f5cd82df312d2074d1b-bfc2e3699b994110b6d496a49bc7a170 2023-02-14 11:02:03,778 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(310): Store=ac8776cda2c24f5cd82df312d2074d1b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,778 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:02:03,779 DEBUG [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2 2023-02-14 11:02:03,780 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac8776cda2c24f5cd82df312d2074d1b columnFamilyName f2 2023-02-14 11:02:03,791 DEBUG [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/testWithMapReduce=ac8776cda2c24f5cd82df312d2074d1b-9ba9aff25ec244b586ccb356f2b5cda9 2023-02-14 11:02:03,792 INFO [StoreOpener-ac8776cda2c24f5cd82df312d2074d1b-1] regionserver.HStore(310): Store=ac8776cda2c24f5cd82df312d2074d1b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:03,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ac8776cda2c24f5cd82df312d2074d1b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67489296, jitterRate=0.0056688785552978516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:03,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ac8776cda2c24f5cd82df312d2074d1b: 2023-02-14 11:02:03,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ac8776cda2c24f5cd82df312d2074d1b, disabling compactions & flushes 2023-02-14 11:02:03,836 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:03,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:03,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. after waiting 0 ms 2023-02-14 11:02:03,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:03,845 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:03,845 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ac8776cda2c24f5cd82df312d2074d1b: 2023-02-14 11:02:03,850 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:03,851 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:03,855 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:03,861 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:02:03,863 DEBUG [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1 2023-02-14 11:02:03,866 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee0a8ce2f518cad240d966e483a534f3 columnFamilyName f1 2023-02-14 11:02:03,879 DEBUG [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/testWithMapReduce=ee0a8ce2f518cad240d966e483a534f3-4bf3b7997b844bee957d3a5081bac179 2023-02-14 11:02:03,879 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(310): Store=ee0a8ce2f518cad240d966e483a534f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,879 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:02:03,881 DEBUG [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2 2023-02-14 11:02:03,881 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee0a8ce2f518cad240d966e483a534f3 columnFamilyName f2 2023-02-14 11:02:03,896 DEBUG [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/testWithMapReduce=ee0a8ce2f518cad240d966e483a534f3-8c389a4d78b941549e6c62c2b1a5039e 2023-02-14 11:02:03,896 INFO [StoreOpener-ee0a8ce2f518cad240d966e483a534f3-1] regionserver.HStore(310): Store=ee0a8ce2f518cad240d966e483a534f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,896 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:03,896 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ee0a8ce2f518cad240d966e483a534f3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60689120, jitterRate=-0.09566164016723633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:03,896 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ee0a8ce2f518cad240d966e483a534f3: 2023-02-14 11:02:03,958 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ee0a8ce2f518cad240d966e483a534f3, disabling compactions & flushes 2023-02-14 11:02:03,959 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:03,959 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:03,959 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. after waiting 0 ms 2023-02-14 11:02:03,959 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:03,961 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:03,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ee0a8ce2f518cad240d966e483a534f3: 2023-02-14 11:02:03,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:03,969 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:03,971 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:03,974 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:02:03,975 DEBUG [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1 2023-02-14 11:02:03,976 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f18bb77a83aa40a46a7792e3ddbc6b43 columnFamilyName f1 2023-02-14 11:02:03,984 DEBUG [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/testWithMapReduce=f18bb77a83aa40a46a7792e3ddbc6b43-62b4418fd1424893b0a1ded90ad484d3 2023-02-14 11:02:03,984 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(310): Store=f18bb77a83aa40a46a7792e3ddbc6b43/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,984 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:02:03,985 DEBUG [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2 2023-02-14 11:02:03,985 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f18bb77a83aa40a46a7792e3ddbc6b43 columnFamilyName f2 2023-02-14 11:02:03,991 DEBUG [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/testWithMapReduce=f18bb77a83aa40a46a7792e3ddbc6b43-80dedfb7c3b84a0cab47105b8373c743 2023-02-14 11:02:03,992 INFO [StoreOpener-f18bb77a83aa40a46a7792e3ddbc6b43-1] regionserver.HStore(310): Store=f18bb77a83aa40a46a7792e3ddbc6b43/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:03,992 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:03,992 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f18bb77a83aa40a46a7792e3ddbc6b43; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65151569, jitterRate=-0.02916596829891205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:03,992 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f18bb77a83aa40a46a7792e3ddbc6b43: 2023-02-14 11:02:04,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f18bb77a83aa40a46a7792e3ddbc6b43, disabling compactions & flushes 2023-02-14 11:02:04,022 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:04,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:04,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. after waiting 0 ms 2023-02-14 11:02:04,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:04,024 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:04,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f18bb77a83aa40a46a7792e3ddbc6b43: 2023-02-14 11:02:04,028 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:04,029 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:04,030 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:04,032 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:02:04,033 DEBUG [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1 2023-02-14 11:02:04,033 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6fdfdc4338b690965517d43ed5fb869 columnFamilyName f1 2023-02-14 11:02:04,039 DEBUG [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/testWithMapReduce=e6fdfdc4338b690965517d43ed5fb869-719c7eca598048f59cc3b941142c44b5 2023-02-14 11:02:04,040 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(310): Store=e6fdfdc4338b690965517d43ed5fb869/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:04,040 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:02:04,041 DEBUG [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2 2023-02-14 11:02:04,041 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6fdfdc4338b690965517d43ed5fb869 columnFamilyName f2 2023-02-14 11:02:04,047 DEBUG [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(539): loaded hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/testWithMapReduce=e6fdfdc4338b690965517d43ed5fb869-2bb6d2737c894dc79e915918fdbcb94c 2023-02-14 11:02:04,047 INFO [StoreOpener-e6fdfdc4338b690965517d43ed5fb869-1] regionserver.HStore(310): Store=e6fdfdc4338b690965517d43ed5fb869/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:04,048 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:04,048 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e6fdfdc4338b690965517d43ed5fb869; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73532621, jitterRate=0.09572143852710724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:04,048 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e6fdfdc4338b690965517d43ed5fb869: 2023-02-14 11:02:04,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e6fdfdc4338b690965517d43ed5fb869, disabling compactions & flushes 2023-02-14 11:02:04,081 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:04,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:04,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. after waiting 0 ms 2023-02-14 11:02:04,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:04,084 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:04,084 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e6fdfdc4338b690965517d43ed5fb869: 2023-02-14 11:02:04,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:04,097 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:04,104 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:04,106 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:02:04,108 DEBUG [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/f1 2023-02-14 11:02:04,108 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd7a77d12080711034a1c568af3d5c0b columnFamilyName f1 2023-02-14 11:02:04,109 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] regionserver.HStore(310): Store=fd7a77d12080711034a1c568af3d5c0b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:04,109 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:02:04,110 DEBUG [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40851/user/jenkins/test-data/1b5f99a5-052f-01cc-9c62-26332c53f64d/testWithMapReduceMultiRegion/0242ffde-c5ac-41ed-91c1-8e7325ef05bd/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/f2 2023-02-14 11:02:04,110 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd7a77d12080711034a1c568af3d5c0b columnFamilyName f2 2023-02-14 11:02:04,111 INFO [StoreOpener-fd7a77d12080711034a1c568af3d5c0b-1] regionserver.HStore(310): Store=fd7a77d12080711034a1c568af3d5c0b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:04,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:04,111 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fd7a77d12080711034a1c568af3d5c0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62353232, jitterRate=-0.07086443901062012}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:04,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fd7a77d12080711034a1c568af3d5c0b: 2023-02-14 11:02:04,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fd7a77d12080711034a1c568af3d5c0b, disabling compactions & flushes 2023-02-14 11:02:04,130 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:04,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:04,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. after waiting 0 ms 2023-02-14 11:02:04,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:04,130 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:04,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fd7a77d12080711034a1c568af3d5c0b: 2023-02-14 11:02:05,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-14 11:02:05,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-14 11:02:05,009 INFO [Listener at localhost/43295] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-14 11:02:05,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-14 11:02:05,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-14 11:02:05,019 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372525019"}]},"ts":"1676372525019"} 2023-02-14 11:02:05,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-14 11:02:05,021 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-14 11:02:05,023 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-14 11:02:05,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=00e3bb45fb92cf21cd462231c045ce74, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ac8776cda2c24f5cd82df312d2074d1b, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e6fdfdc4338b690965517d43ed5fb869, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c62d1c15ab4f6af58bd8dfd676f41e79, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ee0a8ce2f518cad240d966e483a534f3, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=07b909a3cc6c112a938a75d0808c8089, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=870c3c3f7c4b8d77f340ccc3e823e358, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f18bb77a83aa40a46a7792e3ddbc6b43, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=230a2c8fc9943a86304aff565048b090, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fd7a77d12080711034a1c568af3d5c0b, UNASSIGN}] 2023-02-14 11:02:05,029 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ee0a8ce2f518cad240d966e483a534f3, UNASSIGN 2023-02-14 11:02:05,029 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e6fdfdc4338b690965517d43ed5fb869, UNASSIGN 2023-02-14 11:02:05,030 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ac8776cda2c24f5cd82df312d2074d1b, UNASSIGN 2023-02-14 11:02:05,030 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c62d1c15ab4f6af58bd8dfd676f41e79, UNASSIGN 2023-02-14 11:02:05,030 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fd7a77d12080711034a1c568af3d5c0b, UNASSIGN 2023-02-14 11:02:05,031 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ee0a8ce2f518cad240d966e483a534f3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:05,031 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525031"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525031"}]},"ts":"1676372525031"} 2023-02-14 11:02:05,032 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ac8776cda2c24f5cd82df312d2074d1b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:05,032 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e6fdfdc4338b690965517d43ed5fb869, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:05,032 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525032"}]},"ts":"1676372525032"} 2023-02-14 11:02:05,032 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c62d1c15ab4f6af58bd8dfd676f41e79, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:05,032 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525031"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525031"}]},"ts":"1676372525031"} 2023-02-14 11:02:05,032 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525032"}]},"ts":"1676372525032"} 2023-02-14 11:02:05,033 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=fd7a77d12080711034a1c568af3d5c0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:05,033 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372525032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525032"}]},"ts":"1676372525032"} 2023-02-14 11:02:05,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=38, state=RUNNABLE; CloseRegionProcedure ee0a8ce2f518cad240d966e483a534f3, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:02:05,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure ac8776cda2c24f5cd82df312d2074d1b, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:02:05,036 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=36, state=RUNNABLE; CloseRegionProcedure e6fdfdc4338b690965517d43ed5fb869, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:02:05,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure c62d1c15ab4f6af58bd8dfd676f41e79, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:02:05,040 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure fd7a77d12080711034a1c568af3d5c0b, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:02:05,044 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=230a2c8fc9943a86304aff565048b090, UNASSIGN 2023-02-14 11:02:05,044 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f18bb77a83aa40a46a7792e3ddbc6b43, UNASSIGN 2023-02-14 11:02:05,044 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=870c3c3f7c4b8d77f340ccc3e823e358, UNASSIGN 2023-02-14 11:02:05,045 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=00e3bb45fb92cf21cd462231c045ce74, UNASSIGN 2023-02-14 11:02:05,045 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=07b909a3cc6c112a938a75d0808c8089, UNASSIGN 2023-02-14 11:02:05,046 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=870c3c3f7c4b8d77f340ccc3e823e358, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:05,046 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525046"}]},"ts":"1676372525046"} 2023-02-14 11:02:05,046 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=00e3bb45fb92cf21cd462231c045ce74, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:05,046 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=230a2c8fc9943a86304aff565048b090, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:05,046 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372525046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525046"}]},"ts":"1676372525046"} 2023-02-14 11:02:05,047 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525046"}]},"ts":"1676372525046"} 2023-02-14 11:02:05,047 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f18bb77a83aa40a46a7792e3ddbc6b43, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:05,047 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525047"}]},"ts":"1676372525047"} 2023-02-14 11:02:05,047 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=07b909a3cc6c112a938a75d0808c8089, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:05,047 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372525047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372525047"}]},"ts":"1676372525047"} 2023-02-14 11:02:05,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=40, state=RUNNABLE; CloseRegionProcedure 870c3c3f7c4b8d77f340ccc3e823e358, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:02:05,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=34, state=RUNNABLE; CloseRegionProcedure 00e3bb45fb92cf21cd462231c045ce74, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:02:05,051 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=42, state=RUNNABLE; CloseRegionProcedure 230a2c8fc9943a86304aff565048b090, server=jenkins-hbase4.apache.org,32997,1676372512284}] 2023-02-14 11:02:05,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=41, state=RUNNABLE; CloseRegionProcedure f18bb77a83aa40a46a7792e3ddbc6b43, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:02:05,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=39, state=RUNNABLE; CloseRegionProcedure 07b909a3cc6c112a938a75d0808c8089, server=jenkins-hbase4.apache.org,36959,1676372512234}] 2023-02-14 11:02:05,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-14 11:02:05,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:02:05,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:02:05,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ac8776cda2c24f5cd82df312d2074d1b, disabling compactions & flushes 2023-02-14 11:02:05,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fd7a77d12080711034a1c568af3d5c0b, disabling compactions & flushes 2023-02-14 11:02:05,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:05,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:05,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:05,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:05,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. after waiting 0 ms 2023-02-14 11:02:05,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:05,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. after waiting 0 ms 2023-02-14 11:02:05,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:05,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-14 11:02:05,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b. 2023-02-14 11:02:05,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fd7a77d12080711034a1c568af3d5c0b: 2023-02-14 11:02:05,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:05,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b. 2023-02-14 11:02:05,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ac8776cda2c24f5cd82df312d2074d1b: 2023-02-14 11:02:05,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:02:05,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:02:05,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 07b909a3cc6c112a938a75d0808c8089, disabling compactions & flushes 2023-02-14 11:02:05,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:05,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:05,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. after waiting 0 ms 2023-02-14 11:02:05,214 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=fd7a77d12080711034a1c568af3d5c0b, regionState=CLOSED 2023-02-14 11:02:05,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:05,214 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372525214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525214"}]},"ts":"1676372525214"} 2023-02-14 11:02:05,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:02:05,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:02:05,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 870c3c3f7c4b8d77f340ccc3e823e358, disabling compactions & flushes 2023-02-14 11:02:05,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:05,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:05,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. after waiting 0 ms 2023-02-14 11:02:05,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:05,215 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ac8776cda2c24f5cd82df312d2074d1b, regionState=CLOSED 2023-02-14 11:02:05,215 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525215"}]},"ts":"1676372525215"} 2023-02-14 11:02:05,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-14 11:02:05,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure fd7a77d12080711034a1c568af3d5c0b, server=jenkins-hbase4.apache.org,36959,1676372512234 in 178 msec 2023-02-14 11:02:05,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-14 11:02:05,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure ac8776cda2c24f5cd82df312d2074d1b, server=jenkins-hbase4.apache.org,32997,1676372512284 in 186 msec 2023-02-14 11:02:05,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fd7a77d12080711034a1c568af3d5c0b, UNASSIGN in 194 msec 2023-02-14 11:02:05,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ac8776cda2c24f5cd82df312d2074d1b, UNASSIGN in 198 msec 2023-02-14 11:02:05,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:05,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:05,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089. 2023-02-14 11:02:05,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 07b909a3cc6c112a938a75d0808c8089: 2023-02-14 11:02:05,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358. 2023-02-14 11:02:05,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 870c3c3f7c4b8d77f340ccc3e823e358: 2023-02-14 11:02:05,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:02:05,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:02:05,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c62d1c15ab4f6af58bd8dfd676f41e79, disabling compactions & flushes 2023-02-14 11:02:05,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:05,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:05,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. after waiting 0 ms 2023-02-14 11:02:05,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:05,230 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=07b909a3cc6c112a938a75d0808c8089, regionState=CLOSED 2023-02-14 11:02:05,230 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525230"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525230"}]},"ts":"1676372525230"} 2023-02-14 11:02:05,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:02:05,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 230a2c8fc9943a86304aff565048b090 2023-02-14 11:02:05,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 230a2c8fc9943a86304aff565048b090, disabling compactions & flushes 2023-02-14 11:02:05,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:05,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:05,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. after waiting 0 ms 2023-02-14 11:02:05,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:05,234 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=870c3c3f7c4b8d77f340ccc3e823e358, regionState=CLOSED 2023-02-14 11:02:05,234 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525234"}]},"ts":"1676372525234"} 2023-02-14 11:02:05,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=39 2023-02-14 11:02:05,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=39, state=SUCCESS; CloseRegionProcedure 07b909a3cc6c112a938a75d0808c8089, server=jenkins-hbase4.apache.org,36959,1676372512234 in 181 msec 2023-02-14 11:02:05,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=40 2023-02-14 11:02:05,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=40, state=SUCCESS; CloseRegionProcedure 870c3c3f7c4b8d77f340ccc3e823e358, server=jenkins-hbase4.apache.org,32997,1676372512284 in 187 msec 2023-02-14 11:02:05,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=07b909a3cc6c112a938a75d0808c8089, UNASSIGN in 217 msec 2023-02-14 11:02:05,244 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=870c3c3f7c4b8d77f340ccc3e823e358, UNASSIGN in 218 msec 2023-02-14 11:02:05,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:05,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79. 2023-02-14 11:02:05,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c62d1c15ab4f6af58bd8dfd676f41e79: 2023-02-14 11:02:05,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:05,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090. 2023-02-14 11:02:05,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 230a2c8fc9943a86304aff565048b090: 2023-02-14 11:02:05,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:02:05,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:02:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e6fdfdc4338b690965517d43ed5fb869, disabling compactions & flushes 2023-02-14 11:02:05,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. after waiting 0 ms 2023-02-14 11:02:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:05,261 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c62d1c15ab4f6af58bd8dfd676f41e79, regionState=CLOSED 2023-02-14 11:02:05,261 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525261"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525261"}]},"ts":"1676372525261"} 2023-02-14 11:02:05,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 230a2c8fc9943a86304aff565048b090 2023-02-14 11:02:05,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:02:05,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 00e3bb45fb92cf21cd462231c045ce74, disabling compactions & flushes 2023-02-14 11:02:05,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:05,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:05,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. after waiting 0 ms 2023-02-14 11:02:05,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:05,262 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=230a2c8fc9943a86304aff565048b090, regionState=CLOSED 2023-02-14 11:02:05,262 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525262"}]},"ts":"1676372525262"} 2023-02-14 11:02:05,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-14 11:02:05,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure c62d1c15ab4f6af58bd8dfd676f41e79, server=jenkins-hbase4.apache.org,36959,1676372512234 in 228 msec 2023-02-14 11:02:05,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-14 11:02:05,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74. 2023-02-14 11:02:05,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:05,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 00e3bb45fb92cf21cd462231c045ce74: 2023-02-14 11:02:05,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=42 2023-02-14 11:02:05,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=42, state=SUCCESS; CloseRegionProcedure 230a2c8fc9943a86304aff565048b090, server=jenkins-hbase4.apache.org,32997,1676372512284 in 214 msec 2023-02-14 11:02:05,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869. 2023-02-14 11:02:05,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e6fdfdc4338b690965517d43ed5fb869: 2023-02-14 11:02:05,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c62d1c15ab4f6af58bd8dfd676f41e79, UNASSIGN in 241 msec 2023-02-14 11:02:05,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=230a2c8fc9943a86304aff565048b090, UNASSIGN in 242 msec 2023-02-14 11:02:05,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:02:05,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:02:05,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ee0a8ce2f518cad240d966e483a534f3, disabling compactions & flushes 2023-02-14 11:02:05,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:05,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:05,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. after waiting 0 ms 2023-02-14 11:02:05,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:05,273 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=00e3bb45fb92cf21cd462231c045ce74, regionState=CLOSED 2023-02-14 11:02:05,273 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372525272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525272"}]},"ts":"1676372525272"} 2023-02-14 11:02:05,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:02:05,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:02:05,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f18bb77a83aa40a46a7792e3ddbc6b43, disabling compactions & flushes 2023-02-14 11:02:05,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:05,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:05,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. after waiting 0 ms 2023-02-14 11:02:05,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:05,275 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e6fdfdc4338b690965517d43ed5fb869, regionState=CLOSED 2023-02-14 11:02:05,275 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525275"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525275"}]},"ts":"1676372525275"} 2023-02-14 11:02:05,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=34 2023-02-14 11:02:05,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=34, state=SUCCESS; CloseRegionProcedure 00e3bb45fb92cf21cd462231c045ce74, server=jenkins-hbase4.apache.org,32997,1676372512284 in 226 msec 2023-02-14 11:02:05,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=36 2023-02-14 11:02:05,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=00e3bb45fb92cf21cd462231c045ce74, UNASSIGN in 254 msec 2023-02-14 11:02:05,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=36, state=SUCCESS; CloseRegionProcedure e6fdfdc4338b690965517d43ed5fb869, server=jenkins-hbase4.apache.org,36959,1676372512234 in 242 msec 2023-02-14 11:02:05,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e6fdfdc4338b690965517d43ed5fb869, UNASSIGN in 257 msec 2023-02-14 11:02:05,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:05,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3. 2023-02-14 11:02:05,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ee0a8ce2f518cad240d966e483a534f3: 2023-02-14 11:02:05,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:02:05,288 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ee0a8ce2f518cad240d966e483a534f3, regionState=CLOSED 2023-02-14 11:02:05,288 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525288"}]},"ts":"1676372525288"} 2023-02-14 11:02:05,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:05,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43. 2023-02-14 11:02:05,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f18bb77a83aa40a46a7792e3ddbc6b43: 2023-02-14 11:02:05,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:02:05,294 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f18bb77a83aa40a46a7792e3ddbc6b43, regionState=CLOSED 2023-02-14 11:02:05,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=38 2023-02-14 11:02:05,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=38, state=SUCCESS; CloseRegionProcedure ee0a8ce2f518cad240d966e483a534f3, server=jenkins-hbase4.apache.org,32997,1676372512284 in 257 msec 2023-02-14 11:02:05,294 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372525294"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372525294"}]},"ts":"1676372525294"} 2023-02-14 11:02:05,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ee0a8ce2f518cad240d966e483a534f3, UNASSIGN in 269 msec 2023-02-14 11:02:05,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=41 2023-02-14 11:02:05,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=41, state=SUCCESS; CloseRegionProcedure f18bb77a83aa40a46a7792e3ddbc6b43, server=jenkins-hbase4.apache.org,36959,1676372512234 in 244 msec 2023-02-14 11:02:05,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=33 2023-02-14 11:02:05,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f18bb77a83aa40a46a7792e3ddbc6b43, UNASSIGN in 273 msec 2023-02-14 11:02:05,301 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372525301"}]},"ts":"1676372525301"} 2023-02-14 11:02:05,303 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-14 11:02:05,306 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-14 11:02:05,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 297 msec 2023-02-14 11:02:05,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-14 11:02:05,325 INFO [Listener at localhost/43295] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-14 11:02:05,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-14 11:02:05,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:05,364 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:05,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-14 11:02:05,371 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:05,389 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:02:05,389 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:02:05,390 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:02:05,390 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:02:05,390 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:02:05,389 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:02:05,389 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:02:05,390 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:02:05,399 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/recovered.edits] 2023-02-14 11:02:05,404 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/recovered.edits] 2023-02-14 11:02:05,404 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/recovered.edits] 2023-02-14 11:02:05,405 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/recovered.edits] 2023-02-14 11:02:05,405 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/recovered.edits] 2023-02-14 11:02:05,405 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/recovered.edits] 2023-02-14 11:02:05,405 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/recovered.edits] 2023-02-14 11:02:05,406 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/recovered.edits] 2023-02-14 11:02:05,420 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/1d0166f7d03c4b859129a83373ca6fb1 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/1d0166f7d03c4b859129a83373ca6fb1 2023-02-14 11:02:05,421 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/0a7a54dffa184aaaa1db72d64f9077fa to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/0a7a54dffa184aaaa1db72d64f9077fa 2023-02-14 11:02:05,421 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/62b4418fd1424893b0a1ded90ad484d3 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/62b4418fd1424893b0a1ded90ad484d3 2023-02-14 11:02:05,421 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/bc9a4e0b2d2f4094a49d6be26576c609 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/bc9a4e0b2d2f4094a49d6be26576c609 2023-02-14 11:02:05,422 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/719c7eca598048f59cc3b941142c44b5 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/719c7eca598048f59cc3b941142c44b5 2023-02-14 11:02:05,422 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/35f27fbb42b540d0beff6f1ac02aa9cf to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/35f27fbb42b540d0beff6f1ac02aa9cf 2023-02-14 11:02:05,424 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/6b2f77300ed94c77a693314a0b6991cc to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/6b2f77300ed94c77a693314a0b6991cc 2023-02-14 11:02:05,425 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/f8f9576231e345b4a82f775ff986b9d2 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f1/f8f9576231e345b4a82f775ff986b9d2 2023-02-14 11:02:05,425 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/db7b2e72f0c44aeca2cecb3f42f241c8 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f1/db7b2e72f0c44aeca2cecb3f42f241c8 2023-02-14 11:02:05,426 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/c839b2aa3fd94486b6a029fbcc6c3452 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f1/c839b2aa3fd94486b6a029fbcc6c3452 2023-02-14 11:02:05,426 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/4bf3b7997b844bee957d3a5081bac179 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f1/4bf3b7997b844bee957d3a5081bac179 2023-02-14 11:02:05,429 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/recovered.edits/6.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74/recovered.edits/6.seqid 2023-02-14 11:02:05,429 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/fa9798c60e6b499d99d3d4c78d29d84e to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f1/fa9798c60e6b499d99d3d4c78d29d84e 2023-02-14 11:02:05,431 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/00e3bb45fb92cf21cd462231c045ce74 2023-02-14 11:02:05,431 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090 2023-02-14 11:02:05,431 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/f1331e5705ba443ea7996eb255092467 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f1/f1331e5705ba443ea7996eb255092467 2023-02-14 11:02:05,431 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/bfc2e3699b994110b6d496a49bc7a170 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f1/bfc2e3699b994110b6d496a49bc7a170 2023-02-14 11:02:05,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-14 11:02:05,501 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/2fe5e2859e564d5fa91664a258fa23f6 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/2fe5e2859e564d5fa91664a258fa23f6 2023-02-14 11:02:05,501 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/8c389a4d78b941549e6c62c2b1a5039e to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/8c389a4d78b941549e6c62c2b1a5039e 2023-02-14 11:02:05,501 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/2bb6d2737c894dc79e915918fdbcb94c to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/2bb6d2737c894dc79e915918fdbcb94c 2023-02-14 11:02:05,501 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/5b09719c201947f99fb57c9a8c5e8a51 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/5b09719c201947f99fb57c9a8c5e8a51 2023-02-14 11:02:05,503 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/recovered.edits] 2023-02-14 11:02:05,505 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/74231a43ca364a6c95bd675f65dc7c50 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/74231a43ca364a6c95bd675f65dc7c50 2023-02-14 11:02:05,506 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/c9d3f0a7cb11483480fa702485bb139b to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/c9d3f0a7cb11483480fa702485bb139b 2023-02-14 11:02:05,506 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/9ba9aff25ec244b586ccb356f2b5cda9 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/9ba9aff25ec244b586ccb356f2b5cda9 2023-02-14 11:02:05,506 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/fd182cc444784418a2cdceb0c1beafd3 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/f2/fd182cc444784418a2cdceb0c1beafd3 2023-02-14 11:02:05,506 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/f778ce0d86c24ade98a903468e1b24e5 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/f2/f778ce0d86c24ade98a903468e1b24e5 2023-02-14 11:02:05,507 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/4b4d25cc03f94c499fcea984b27ca9f9 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/f2/4b4d25cc03f94c499fcea984b27ca9f9 2023-02-14 11:02:05,507 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/7e3f808ea10545ce9880db3ea565c39b to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/f2/7e3f808ea10545ce9880db3ea565c39b 2023-02-14 11:02:05,513 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/80dedfb7c3b84a0cab47105b8373c743 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/f2/80dedfb7c3b84a0cab47105b8373c743 2023-02-14 11:02:05,513 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/f0793b0e636945888c434ad90f4c5f57 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/f2/f0793b0e636945888c434ad90f4c5f57 2023-02-14 11:02:05,513 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/bb5c162e50824772967cbf3727686a86 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/f2/bb5c162e50824772967cbf3727686a86 2023-02-14 11:02:05,515 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/b39cf6b6072b4418a8fe211e2bd9a4f3 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/b39cf6b6072b4418a8fe211e2bd9a4f3 2023-02-14 11:02:05,515 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/recovered.edits/12.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869/recovered.edits/12.seqid 2023-02-14 11:02:05,516 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/recovered.edits/12.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3/recovered.edits/12.seqid 2023-02-14 11:02:05,517 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/recovered.edits/12.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79/recovered.edits/12.seqid 2023-02-14 11:02:05,517 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/e6fdfdc4338b690965517d43ed5fb869 2023-02-14 11:02:05,517 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:02:05,517 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/recovered.edits/12.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358/recovered.edits/12.seqid 2023-02-14 11:02:05,519 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ee0a8ce2f518cad240d966e483a534f3 2023-02-14 11:02:05,519 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/c62d1c15ab4f6af58bd8dfd676f41e79 2023-02-14 11:02:05,519 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/870c3c3f7c4b8d77f340ccc3e823e358 2023-02-14 11:02:05,520 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/fdfaccae205d48a2807780217ede46dd to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f1/fdfaccae205d48a2807780217ede46dd 2023-02-14 11:02:05,522 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/f1, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/f2, FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/recovered.edits] 2023-02-14 11:02:05,522 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/recovered.edits/12.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43/recovered.edits/12.seqid 2023-02-14 11:02:05,523 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/recovered.edits/12.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b/recovered.edits/12.seqid 2023-02-14 11:02:05,523 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/recovered.edits/12.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089/recovered.edits/12.seqid 2023-02-14 11:02:05,523 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/f18bb77a83aa40a46a7792e3ddbc6b43 2023-02-14 11:02:05,524 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/ac8776cda2c24f5cd82df312d2074d1b 2023-02-14 11:02:05,524 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/07b909a3cc6c112a938a75d0808c8089 2023-02-14 11:02:05,525 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/1c00db0155fc4166ac5c8954a2f3bc98 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/1c00db0155fc4166ac5c8954a2f3bc98 2023-02-14 11:02:05,527 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/e8b3c0d3383d40de98574b3d32f93b87 to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/f2/e8b3c0d3383d40de98574b3d32f93b87 2023-02-14 11:02:05,529 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/recovered.edits/6.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b/recovered.edits/6.seqid 2023-02-14 11:02:05,530 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/fd7a77d12080711034a1c568af3d5c0b 2023-02-14 11:02:05,530 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/recovered.edits/12.seqid to hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/archive/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090/recovered.edits/12.seqid 2023-02-14 11:02:05,530 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/.tmp/data/default/testWithMapReduce/230a2c8fc9943a86304aff565048b090 2023-02-14 11:02:05,530 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-14 11:02:05,533 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:05,562 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-14 11:02:05,566 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,568 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372525568"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,573 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-14 11:02:05,573 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 00e3bb45fb92cf21cd462231c045ce74, NAME => 'testWithMapReduce,,1676372516352.00e3bb45fb92cf21cd462231c045ce74.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => ac8776cda2c24f5cd82df312d2074d1b, NAME => 'testWithMapReduce,aaa,1676372516352.ac8776cda2c24f5cd82df312d2074d1b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => e6fdfdc4338b690965517d43ed5fb869, NAME => 'testWithMapReduce,d\x84\x84,1676372516352.e6fdfdc4338b690965517d43ed5fb869.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => c62d1c15ab4f6af58bd8dfd676f41e79, NAME => 'testWithMapReduce,g\xA7\xA7,1676372516352.c62d1c15ab4f6af58bd8dfd676f41e79.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => ee0a8ce2f518cad240d966e483a534f3, NAME => 'testWithMapReduce,j\xCA\xCA,1676372516352.ee0a8ce2f518cad240d966e483a534f3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 07b909a3cc6c112a938a75d0808c8089, NAME => 'testWithMapReduce,m\xED\xED,1676372516352.07b909a3cc6c112a938a75d0808c8089.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 870c3c3f7c4b8d77f340ccc3e823e358, NAME => 'testWithMapReduce,q\x11\x10,1676372516352.870c3c3f7c4b8d77f340ccc3e823e358.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => f18bb77a83aa40a46a7792e3ddbc6b43, NAME => 'testWithMapReduce,t43,1676372516352.f18bb77a83aa40a46a7792e3ddbc6b43.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 230a2c8fc9943a86304aff565048b090, NAME => 'testWithMapReduce,wWV,1676372516352.230a2c8fc9943a86304aff565048b090.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => fd7a77d12080711034a1c568af3d5c0b, NAME => 'testWithMapReduce,zz{,1676372516352.fd7a77d12080711034a1c568af3d5c0b.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-14 11:02:05,573 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-14 11:02:05,574 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676372525574"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:05,576 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-14 11:02:05,578 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:05,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 245 msec 2023-02-14 11:02:05,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45133] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-14 11:02:05,700 INFO [Listener at localhost/43295] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-14 11:02:05,701 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-14 11:02:05,701 INFO [Listener at localhost/43295] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-14 11:02:05,701 DEBUG [Listener at localhost/43295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x351d31b4 to 127.0.0.1:52840 2023-02-14 11:02:05,701 DEBUG [Listener at localhost/43295] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:05,701 DEBUG [Listener at localhost/43295] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-14 11:02:05,701 DEBUG [Listener at localhost/43295] util.JVMClusterUtil(257): Found active master hash=204337313, stopped=false 2023-02-14 11:02:05,702 INFO [Listener at localhost/43295] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:02:05,704 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:05,704 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:05,705 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:05,704 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:05,704 INFO [Listener at localhost/43295] procedure2.ProcedureExecutor(629): Stopping 2023-02-14 11:02:05,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:05,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:05,707 DEBUG [Listener at localhost/43295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fcb3eec to 127.0.0.1:52840 2023-02-14 11:02:05,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:05,707 DEBUG [Listener at localhost/43295] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:05,707 INFO [Listener at localhost/43295] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36959,1676372512234' ***** 2023-02-14 11:02:05,707 INFO [Listener at localhost/43295] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:05,707 INFO [Listener at localhost/43295] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32997,1676372512284' ***** 2023-02-14 11:02:05,707 INFO [Listener at localhost/43295] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:05,707 INFO [RS:0;jenkins-hbase4:36959] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:05,708 INFO [RS:1;jenkins-hbase4:32997] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:05,708 INFO [RS:1;jenkins-hbase4:32997] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:05,708 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:05,708 INFO [RS:1;jenkins-hbase4:32997] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:05,709 INFO [RS:0;jenkins-hbase4:36959] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:05,709 INFO [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:05,709 INFO [RS:0;jenkins-hbase4:36959] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:05,709 DEBUG [RS:1;jenkins-hbase4:32997] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x279aa8b0 to 127.0.0.1:52840 2023-02-14 11:02:05,709 DEBUG [RS:1;jenkins-hbase4:32997] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:05,709 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(3304): Received CLOSE for e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:02:05,709 INFO [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32997,1676372512284; all regions closed. 2023-02-14 11:02:05,709 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:05,709 DEBUG [RS:0;jenkins-hbase4:36959] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x328b66e1 to 127.0.0.1:52840 2023-02-14 11:02:05,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e96a3f1fb290eceae6863cbf72f676ca, disabling compactions & flushes 2023-02-14 11:02:05,709 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:05,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:02:05,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:02:05,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. after waiting 0 ms 2023-02-14 11:02:05,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:02:05,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e96a3f1fb290eceae6863cbf72f676ca 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-14 11:02:05,710 DEBUG [RS:0;jenkins-hbase4:36959] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:05,712 INFO [RS:0;jenkins-hbase4:36959] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:05,712 INFO [RS:0;jenkins-hbase4:36959] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:05,712 INFO [RS:0;jenkins-hbase4:36959] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:05,712 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-14 11:02:05,713 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-14 11:02:05,713 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, e96a3f1fb290eceae6863cbf72f676ca=hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca.} 2023-02-14 11:02:05,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:05,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:05,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:05,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:05,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:05,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-14 11:02:05,719 DEBUG [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1505): Waiting on 1588230740, e96a3f1fb290eceae6863cbf72f676ca 2023-02-14 11:02:05,725 DEBUG [RS:1;jenkins-hbase4:32997] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/oldWALs 2023-02-14 11:02:05,725 INFO [RS:1;jenkins-hbase4:32997] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32997%2C1676372512284:(num 1676372515710) 2023-02-14 11:02:05,725 DEBUG [RS:1;jenkins-hbase4:32997] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:05,725 INFO [RS:1;jenkins-hbase4:32997] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:05,726 INFO [RS:1;jenkins-hbase4:32997] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:05,726 INFO [RS:1;jenkins-hbase4:32997] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:05,726 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:05,726 INFO [RS:1;jenkins-hbase4:32997] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:05,726 INFO [RS:1;jenkins-hbase4:32997] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:05,727 INFO [RS:1;jenkins-hbase4:32997] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32997 2023-02-14 11:02:05,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca/.tmp/info/ce1981f2486a4f4d8c7300a481ef083c 2023-02-14 11:02:05,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/.tmp/info/35c9078667854214a52b7c431f552e1c 2023-02-14 11:02:05,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca/.tmp/info/ce1981f2486a4f4d8c7300a481ef083c as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca/info/ce1981f2486a4f4d8c7300a481ef083c 2023-02-14 11:02:05,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35c9078667854214a52b7c431f552e1c 2023-02-14 11:02:05,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca/info/ce1981f2486a4f4d8c7300a481ef083c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-14 11:02:05,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e96a3f1fb290eceae6863cbf72f676ca in 47ms, sequenceid=6, compaction requested=false 2023-02-14 11:02:05,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/namespace/e96a3f1fb290eceae6863cbf72f676ca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-14 11:02:05,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:02:05,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e96a3f1fb290eceae6863cbf72f676ca: 2023-02-14 11:02:05,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676372515314.e96a3f1fb290eceae6863cbf72f676ca. 2023-02-14 11:02:05,777 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/.tmp/rep_barrier/2ab7da1bd2e649248bd84d4935b06b6a 2023-02-14 11:02:05,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ab7da1bd2e649248bd84d4935b06b6a 2023-02-14 11:02:05,794 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:05,794 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:05,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/.tmp/table/97574357f87945a9a777af209a55f34d 2023-02-14 11:02:05,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97574357f87945a9a777af209a55f34d 2023-02-14 11:02:05,805 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/.tmp/info/35c9078667854214a52b7c431f552e1c as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/info/35c9078667854214a52b7c431f552e1c 2023-02-14 11:02:05,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35c9078667854214a52b7c431f552e1c 2023-02-14 11:02:05,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/info/35c9078667854214a52b7c431f552e1c, entries=30, sequenceid=57, filesize=7.9 K 2023-02-14 11:02:05,812 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/.tmp/rep_barrier/2ab7da1bd2e649248bd84d4935b06b6a as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/rep_barrier/2ab7da1bd2e649248bd84d4935b06b6a 2023-02-14 11:02:05,815 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:05,815 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:05,815 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32997,1676372512284 2023-02-14 11:02:05,815 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:05,815 ERROR [Listener at localhost/43295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7545e44f rejected from java.util.concurrent.ThreadPoolExecutor@717a7e3f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:05,815 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:05,819 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32997,1676372512284] 2023-02-14 11:02:05,819 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32997,1676372512284; numProcessing=1 2023-02-14 11:02:05,819 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ab7da1bd2e649248bd84d4935b06b6a 2023-02-14 11:02:05,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/rep_barrier/2ab7da1bd2e649248bd84d4935b06b6a, entries=10, sequenceid=57, filesize=5.9 K 2023-02-14 11:02:05,820 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32997,1676372512284 already deleted, retry=false 2023-02-14 11:02:05,820 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32997,1676372512284 expired; onlineServers=1 2023-02-14 11:02:05,821 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/.tmp/table/97574357f87945a9a777af209a55f34d as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/table/97574357f87945a9a777af209a55f34d 2023-02-14 11:02:05,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97574357f87945a9a777af209a55f34d 2023-02-14 11:02:05,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/table/97574357f87945a9a777af209a55f34d, entries=13, sequenceid=57, filesize=5.9 K 2023-02-14 11:02:05,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 112ms, sequenceid=57, compaction requested=false 2023-02-14 11:02:05,840 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-14 11:02:05,841 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:05,842 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:05,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:05,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:05,919 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36959,1676372512234; all regions closed. 2023-02-14 11:02:05,925 DEBUG [RS:0;jenkins-hbase4:36959] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/oldWALs 2023-02-14 11:02:05,925 INFO [RS:0;jenkins-hbase4:36959] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36959%2C1676372512234.meta:.meta(num 1676372515020) 2023-02-14 11:02:05,929 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/WALs/jenkins-hbase4.apache.org,36959,1676372512234/jenkins-hbase4.apache.org%2C36959%2C1676372512234.1676372515712 not finished, retry = 0 2023-02-14 11:02:06,032 DEBUG [RS:0;jenkins-hbase4:36959] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/oldWALs 2023-02-14 11:02:06,032 INFO [RS:0;jenkins-hbase4:36959] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36959%2C1676372512234:(num 1676372515712) 2023-02-14 11:02:06,032 DEBUG [RS:0;jenkins-hbase4:36959] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:06,032 INFO [RS:0;jenkins-hbase4:36959] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:06,033 INFO [RS:0;jenkins-hbase4:36959] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:06,033 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:06,034 INFO [RS:0;jenkins-hbase4:36959] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36959 2023-02-14 11:02:06,038 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:06,038 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36959,1676372512234 2023-02-14 11:02:06,038 ERROR [Listener at localhost/43295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@828871e rejected from java.util.concurrent.ThreadPoolExecutor@c1702c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:06,039 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36959,1676372512234] 2023-02-14 11:02:06,040 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36959,1676372512234; numProcessing=2 2023-02-14 11:02:06,042 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36959,1676372512234 already deleted, retry=false 2023-02-14 11:02:06,042 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36959,1676372512234 expired; onlineServers=0 2023-02-14 11:02:06,042 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45133,1676372511006' ***** 2023-02-14 11:02:06,042 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-14 11:02:06,043 DEBUG [M:0;jenkins-hbase4:45133] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d10fa9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:06,043 INFO [M:0;jenkins-hbase4:45133] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45133,1676372511006 2023-02-14 11:02:06,043 INFO [M:0;jenkins-hbase4:45133] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45133,1676372511006; all regions closed. 2023-02-14 11:02:06,043 DEBUG [M:0;jenkins-hbase4:45133] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:06,043 DEBUG [M:0;jenkins-hbase4:45133] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-14 11:02:06,043 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-14 11:02:06,043 DEBUG [M:0;jenkins-hbase4:45133] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-14 11:02:06,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372513521] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372513521,5,FailOnTimeoutGroup] 2023-02-14 11:02:06,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372513521] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372513521,5,FailOnTimeoutGroup] 2023-02-14 11:02:06,045 INFO [M:0;jenkins-hbase4:45133] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-14 11:02:06,046 INFO [M:0;jenkins-hbase4:45133] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-14 11:02:06,046 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:06,046 INFO [M:0;jenkins-hbase4:45133] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-14 11:02:06,046 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:06,046 DEBUG [M:0;jenkins-hbase4:45133] master.HMaster(1512): Stopping service threads 2023-02-14 11:02:06,046 INFO [M:0;jenkins-hbase4:45133] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-14 11:02:06,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:06,046 ERROR [M:0;jenkins-hbase4:45133] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-14 11:02:06,047 INFO [M:0;jenkins-hbase4:45133] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-14 11:02:06,047 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-14 11:02:06,048 DEBUG [M:0;jenkins-hbase4:45133] zookeeper.ZKUtil(398): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-14 11:02:06,048 WARN [M:0;jenkins-hbase4:45133] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-14 11:02:06,048 INFO [M:0;jenkins-hbase4:45133] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-14 11:02:06,048 INFO [M:0;jenkins-hbase4:45133] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-14 11:02:06,049 DEBUG [M:0;jenkins-hbase4:45133] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:06,049 INFO [M:0;jenkins-hbase4:45133] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:06,049 DEBUG [M:0;jenkins-hbase4:45133] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:06,049 DEBUG [M:0;jenkins-hbase4:45133] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:06,049 DEBUG [M:0;jenkins-hbase4:45133] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:06,049 INFO [M:0;jenkins-hbase4:45133] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.28 KB heapSize=192.19 KB 2023-02-14 11:02:06,071 INFO [M:0;jenkins-hbase4:45133] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.28 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a0714cdffa8e4d419597b3cf096254f3 2023-02-14 11:02:06,078 DEBUG [M:0;jenkins-hbase4:45133] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a0714cdffa8e4d419597b3cf096254f3 as hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a0714cdffa8e4d419597b3cf096254f3 2023-02-14 11:02:06,084 INFO [M:0;jenkins-hbase4:45133] regionserver.HStore(1080): Added hdfs://localhost:40851/user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a0714cdffa8e4d419597b3cf096254f3, entries=53, sequenceid=357, filesize=10.4 K 2023-02-14 11:02:06,085 INFO [M:0;jenkins-hbase4:45133] regionserver.HRegion(2947): Finished flush of dataSize ~159.28 KB/163106, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 36ms, sequenceid=357, compaction requested=false 2023-02-14 11:02:06,086 INFO [M:0;jenkins-hbase4:45133] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:06,086 DEBUG [M:0;jenkins-hbase4:45133] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:06,090 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9d10c998-0069-8f13-ea97-c2026bb02964/MasterData/WALs/jenkins-hbase4.apache.org,45133,1676372511006/jenkins-hbase4.apache.org%2C45133%2C1676372511006.1676372512801 not finished, retry = 0 2023-02-14 11:02:06,106 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:06,106 INFO [RS:1;jenkins-hbase4:32997] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32997,1676372512284; zookeeper connection closed. 2023-02-14 11:02:06,106 ERROR [Listener at localhost/43295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f3bbdd9 rejected from java.util.concurrent.ThreadPoolExecutor@717a7e3f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:06,106 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@355e0f37] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@355e0f37 2023-02-14 11:02:06,106 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:32997-0x100527e6f160002, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:06,106 ERROR [Listener at localhost/43295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@272f50e4 rejected from java.util.concurrent.ThreadPoolExecutor@717a7e3f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:06,192 INFO [M:0;jenkins-hbase4:45133] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-14 11:02:06,192 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:06,193 INFO [M:0;jenkins-hbase4:45133] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45133 2023-02-14 11:02:06,197 DEBUG [M:0;jenkins-hbase4:45133] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45133,1676372511006 already deleted, retry=false 2023-02-14 11:02:06,206 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:06,206 INFO [RS:0;jenkins-hbase4:36959] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36959,1676372512234; zookeeper connection closed. 2023-02-14 11:02:06,206 ERROR [Listener at localhost/43295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@344ad745 rejected from java.util.concurrent.ThreadPoolExecutor@c1702c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:06,206 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6b560c78] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6b560c78 2023-02-14 11:02:06,206 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): regionserver:36959-0x100527e6f160001, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:06,207 ERROR [Listener at localhost/43295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4ca3a27e rejected from java.util.concurrent.ThreadPoolExecutor@c1702c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:06,207 INFO [Listener at localhost/43295] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-14 11:02:06,306 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:06,306 INFO [M:0;jenkins-hbase4:45133] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45133,1676372511006; zookeeper connection closed. 2023-02-14 11:02:06,307 ERROR [Listener at localhost/43295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f2c69ef rejected from java.util.concurrent.ThreadPoolExecutor@2344fd1f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:06,307 DEBUG [Listener at localhost/43295-EventThread] zookeeper.ZKWatcher(600): master:45133-0x100527e6f160000, quorum=127.0.0.1:52840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:06,307 ERROR [Listener at localhost/43295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40f7d20e rejected from java.util.concurrent.ThreadPoolExecutor@2344fd1f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:06,309 WARN [Listener at localhost/43295] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:06,315 INFO [Listener at localhost/43295] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:06,323 WARN [BP-1715229979-172.31.14.131-1676372507283 heartbeating to localhost/127.0.0.1:40851] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:06,323 WARN [BP-1715229979-172.31.14.131-1676372507283 heartbeating to localhost/127.0.0.1:40851] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1715229979-172.31.14.131-1676372507283 (Datanode Uuid 8afdb919-0700-4103-baa8-87861fa7e3c3) service to localhost/127.0.0.1:40851 2023-02-14 11:02:06,326 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/cluster_79e85347-5204-a843-a291-fabdd627fb86/dfs/data/data3/current/BP-1715229979-172.31.14.131-1676372507283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:06,326 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/cluster_79e85347-5204-a843-a291-fabdd627fb86/dfs/data/data4/current/BP-1715229979-172.31.14.131-1676372507283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:06,329 WARN [Listener at localhost/43295] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:06,341 INFO [Listener at localhost/43295] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:06,444 WARN [BP-1715229979-172.31.14.131-1676372507283 heartbeating to localhost/127.0.0.1:40851] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:06,444 WARN [BP-1715229979-172.31.14.131-1676372507283 heartbeating to localhost/127.0.0.1:40851] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1715229979-172.31.14.131-1676372507283 (Datanode Uuid 9ed847e7-03fb-4633-8e71-64a3de9f42c8) service to localhost/127.0.0.1:40851 2023-02-14 11:02:06,445 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/cluster_79e85347-5204-a843-a291-fabdd627fb86/dfs/data/data1/current/BP-1715229979-172.31.14.131-1676372507283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:06,446 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/cluster_79e85347-5204-a843-a291-fabdd627fb86/dfs/data/data2/current/BP-1715229979-172.31.14.131-1676372507283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:06,489 INFO [Listener at localhost/43295] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:06,610 INFO [Listener at localhost/43295] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-14 11:02:06,684 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-14 11:02:06,704 INFO [Listener at localhost/43295] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:40851 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:40851 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:40851 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@166c52f5 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43295 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:40851 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45133,1676372511006)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:40851 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:40851 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40851 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=535 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=289 (was 202) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=6020 (was 7031) 2023-02-14 11:02:06,714 INFO [Listener at localhost/43295] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=535, MaxFileDescriptor=60000, SystemLoadAverage=289, ProcessCount=168, AvailableMemoryMB=6020 2023-02-14 11:02:06,731 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop.log.dir so I do NOT create it in target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a 2023-02-14 11:02:06,731 WARN [Listener at localhost/43295] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop.log.dir Erasing configuration value by system value. 2023-02-14 11:02:06,731 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop.tmp.dir so I do NOT create it in target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a 2023-02-14 11:02:06,731 WARN [Listener at localhost/43295] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f43bf137-40ab-6d1c-b438-571d7ea8fb86/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-14 11:02:06,731 DEBUG [Listener at localhost/43295] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a 2023-02-14 11:02:06,732 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-14 11:02:06,732 INFO [Listener at localhost/43295] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/cluster_5e6e037c-2d82-8d7e-6615-77ac58c3ffbe, deleteOnExit=true 2023-02-14 11:02:06,732 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-14 11:02:06,732 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/test.cache.data in system properties and HBase conf 2023-02-14 11:02:06,733 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop.tmp.dir in system properties and HBase conf 2023-02-14 11:02:06,733 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop.log.dir in system properties and HBase conf 2023-02-14 11:02:06,733 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-14 11:02:06,733 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-14 11:02:06,733 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-14 11:02:06,733 DEBUG [Listener at localhost/43295] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-14 11:02:06,734 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:06,734 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:06,734 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-14 11:02:06,734 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:06,734 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-14 11:02:06,735 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-14 11:02:06,735 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:06,735 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:06,735 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-14 11:02:06,735 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/nfs.dump.dir in system properties and HBase conf 2023-02-14 11:02:06,735 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/java.io.tmpdir in system properties and HBase conf 2023-02-14 11:02:06,736 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:06,736 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-14 11:02:06,736 INFO [Listener at localhost/43295] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-14 11:02:06,741 WARN [Listener at localhost/43295] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:06,741 WARN [Listener at localhost/43295] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:06,784 WARN [Listener at localhost/43295] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:06,786 INFO [Listener at localhost/43295] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:06,792 INFO [Listener at localhost/43295] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/java.io.tmpdir/Jetty_localhost_45279_hdfs____.bv1nmr/webapp 2023-02-14 11:02:06,900 INFO [Listener at localhost/43295] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45279 2023-02-14 11:02:06,905 WARN [Listener at localhost/43295] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:06,905 WARN [Listener at localhost/43295] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:06,964 WARN [Listener at localhost/32885] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:06,987 WARN [Listener at localhost/32885] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:06,990 WARN [Listener at localhost/32885] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:06,991 INFO [Listener at localhost/32885] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:06,999 INFO [Listener at localhost/32885] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/java.io.tmpdir/Jetty_localhost_43347_datanode____.4syf0i/webapp 2023-02-14 11:02:07,115 INFO [Listener at localhost/32885] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43347 2023-02-14 11:02:07,124 WARN [Listener at localhost/44387] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:07,144 WARN [Listener at localhost/44387] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:07,146 WARN [Listener at localhost/44387] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:07,147 INFO [Listener at localhost/44387] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:07,152 INFO [Listener at localhost/44387] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/java.io.tmpdir/Jetty_localhost_34721_datanode____.w4ja3o/webapp 2023-02-14 11:02:07,259 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0b5ce8f5d00f471: Processing first storage report for DS-b3680d55-857c-4e87-b610-71814fd1c831 from datanode bc58fce3-3593-440f-abe2-bff7acc1189f 2023-02-14 11:02:07,260 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0b5ce8f5d00f471: from storage DS-b3680d55-857c-4e87-b610-71814fd1c831 node DatanodeRegistration(127.0.0.1:40777, datanodeUuid=bc58fce3-3593-440f-abe2-bff7acc1189f, infoPort=36123, infoSecurePort=0, ipcPort=44387, storageInfo=lv=-57;cid=testClusterID;nsid=637627425;c=1676372526744), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:07,260 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0b5ce8f5d00f471: Processing first storage report for DS-5abe1b1b-c298-4f3a-9f9c-cf506837954e from datanode bc58fce3-3593-440f-abe2-bff7acc1189f 2023-02-14 11:02:07,260 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0b5ce8f5d00f471: from storage DS-5abe1b1b-c298-4f3a-9f9c-cf506837954e node DatanodeRegistration(127.0.0.1:40777, datanodeUuid=bc58fce3-3593-440f-abe2-bff7acc1189f, infoPort=36123, infoSecurePort=0, ipcPort=44387, storageInfo=lv=-57;cid=testClusterID;nsid=637627425;c=1676372526744), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:07,270 INFO [Listener at localhost/44387] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34721 2023-02-14 11:02:07,280 WARN [Listener at localhost/41749] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:07,405 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd2de9dfd1ee0d41: Processing first storage report for DS-6878460e-9cdf-4bac-b440-0559ab0cffeb from datanode af3cd61a-e66c-4db4-9bd4-ba42cfd735ed 2023-02-14 11:02:07,405 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd2de9dfd1ee0d41: from storage DS-6878460e-9cdf-4bac-b440-0559ab0cffeb node DatanodeRegistration(127.0.0.1:40255, datanodeUuid=af3cd61a-e66c-4db4-9bd4-ba42cfd735ed, infoPort=44655, infoSecurePort=0, ipcPort=41749, storageInfo=lv=-57;cid=testClusterID;nsid=637627425;c=1676372526744), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:07,405 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd2de9dfd1ee0d41: Processing first storage report for DS-cf0ce10e-ccff-4d5a-8f96-d39290547ff6 from datanode af3cd61a-e66c-4db4-9bd4-ba42cfd735ed 2023-02-14 11:02:07,405 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd2de9dfd1ee0d41: from storage DS-cf0ce10e-ccff-4d5a-8f96-d39290547ff6 node DatanodeRegistration(127.0.0.1:40255, datanodeUuid=af3cd61a-e66c-4db4-9bd4-ba42cfd735ed, infoPort=44655, infoSecurePort=0, ipcPort=41749, storageInfo=lv=-57;cid=testClusterID;nsid=637627425;c=1676372526744), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:07,501 DEBUG [Listener at localhost/41749] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a 2023-02-14 11:02:07,508 INFO [Listener at localhost/41749] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/cluster_5e6e037c-2d82-8d7e-6615-77ac58c3ffbe/zookeeper_0, clientPort=54770, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/cluster_5e6e037c-2d82-8d7e-6615-77ac58c3ffbe/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/cluster_5e6e037c-2d82-8d7e-6615-77ac58c3ffbe/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-14 11:02:07,510 INFO [Listener at localhost/41749] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54770 2023-02-14 11:02:07,510 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,512 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,535 INFO [Listener at localhost/41749] util.FSUtils(479): Created version file at hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce with version=8 2023-02-14 11:02:07,536 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,537 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,538 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/hbase-staging 2023-02-14 11:02:07,541 INFO [Listener at localhost/41749] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:07,541 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:07,541 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:07,541 INFO [Listener at localhost/41749] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:07,541 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:07,541 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:07,541 INFO [Listener at localhost/41749] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:07,543 INFO [Listener at localhost/41749] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40109 2023-02-14 11:02:07,543 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,544 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,545 INFO [Listener at localhost/41749] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40109 connecting to ZooKeeper ensemble=127.0.0.1:54770 2023-02-14 11:02:07,561 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:401090x0, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:07,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40109-0x100527eb3560000 connected 2023-02-14 11:02:07,586 DEBUG [Listener at localhost/41749] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:07,586 DEBUG [Listener at localhost/41749] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:07,587 DEBUG [Listener at localhost/41749] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:07,596 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40109 2023-02-14 11:02:07,596 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40109 2023-02-14 11:02:07,600 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40109 2023-02-14 11:02:07,604 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40109 2023-02-14 11:02:07,604 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40109 2023-02-14 11:02:07,604 INFO [Listener at localhost/41749] master.HMaster(444): hbase.rootdir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce, hbase.cluster.distributed=false 2023-02-14 11:02:07,624 INFO [Listener at localhost/41749] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:07,624 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:07,624 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:07,624 INFO [Listener at localhost/41749] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:07,624 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:07,625 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:07,625 INFO [Listener at localhost/41749] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:07,631 INFO [Listener at localhost/41749] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36277 2023-02-14 11:02:07,632 INFO [Listener at localhost/41749] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:07,640 DEBUG [Listener at localhost/41749] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:07,641 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,642 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,643 INFO [Listener at localhost/41749] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36277 connecting to ZooKeeper ensemble=127.0.0.1:54770 2023-02-14 11:02:07,647 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:362770x0, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:07,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36277-0x100527eb3560001 connected 2023-02-14 11:02:07,648 DEBUG [Listener at localhost/41749] zookeeper.ZKUtil(164): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:07,649 DEBUG [Listener at localhost/41749] zookeeper.ZKUtil(164): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:07,649 DEBUG [Listener at localhost/41749] zookeeper.ZKUtil(164): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:07,651 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36277 2023-02-14 11:02:07,656 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36277 2023-02-14 11:02:07,656 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36277 2023-02-14 11:02:07,660 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36277 2023-02-14 11:02:07,660 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36277 2023-02-14 11:02:07,678 INFO [Listener at localhost/41749] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:07,679 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:07,679 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:07,679 INFO [Listener at localhost/41749] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:07,679 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:07,679 INFO [Listener at localhost/41749] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:07,679 INFO [Listener at localhost/41749] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:07,681 INFO [Listener at localhost/41749] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46753 2023-02-14 11:02:07,682 INFO [Listener at localhost/41749] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:07,683 DEBUG [Listener at localhost/41749] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:07,684 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,685 INFO [Listener at localhost/41749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,686 INFO [Listener at localhost/41749] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46753 connecting to ZooKeeper ensemble=127.0.0.1:54770 2023-02-14 11:02:07,691 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:467530x0, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:07,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46753-0x100527eb3560002 connected 2023-02-14 11:02:07,692 DEBUG [Listener at localhost/41749] zookeeper.ZKUtil(164): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:07,692 DEBUG [Listener at localhost/41749] zookeeper.ZKUtil(164): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:07,693 DEBUG [Listener at localhost/41749] zookeeper.ZKUtil(164): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:07,696 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46753 2023-02-14 11:02:07,696 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46753 2023-02-14 11:02:07,697 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46753 2023-02-14 11:02:07,705 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46753 2023-02-14 11:02:07,706 DEBUG [Listener at localhost/41749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46753 2023-02-14 11:02:07,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:07,712 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:07,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:07,714 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:07,714 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:07,714 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:07,714 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:07,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:07,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40109,1676372527540 from backup master directory 2023-02-14 11:02:07,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:07,719 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:07,719 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:07,719 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:07,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:07,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/hbase.id with ID: b1fb8102-dea9-4a3f-baa1-4695a5558d50 2023-02-14 11:02:07,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:07,757 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:07,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x02c9b2b8 to 127.0.0.1:54770 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:07,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@160d3782, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:07,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:07,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-14 11:02:07,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:07,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/data/master/store-tmp 2023-02-14 11:02:07,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:07,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:07,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:07,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:07,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:07,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:07,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:07,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:07,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/WALs/jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:07,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40109%2C1676372527540, suffix=, logDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/WALs/jenkins-hbase4.apache.org,40109,1676372527540, archiveDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/oldWALs, maxLogs=10 2023-02-14 11:02:07,830 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK] 2023-02-14 11:02:07,831 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK] 2023-02-14 11:02:07,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/WALs/jenkins-hbase4.apache.org,40109,1676372527540/jenkins-hbase4.apache.org%2C40109%2C1676372527540.1676372527811 2023-02-14 11:02:07,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK], DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK]] 2023-02-14 11:02:07,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:07,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:07,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:07,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:07,837 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:07,839 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-14 11:02:07,839 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-14 11:02:07,840 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:07,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:07,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:07,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:07,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:07,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68579820, jitterRate=0.021918952465057373}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:07,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:07,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-14 11:02:07,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-14 11:02:07,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-14 11:02:07,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-14 11:02:07,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-14 11:02:07,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-14 11:02:07,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-14 11:02:07,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-14 11:02:07,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-14 11:02:07,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-14 11:02:07,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-14 11:02:07,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-14 11:02:07,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-14 11:02:07,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-14 11:02:07,880 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:07,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-14 11:02:07,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-14 11:02:07,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-14 11:02:07,884 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:07,884 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:07,884 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:07,884 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:07,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40109,1676372527540, sessionid=0x100527eb3560000, setting cluster-up flag (Was=false) 2023-02-14 11:02:07,894 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:07,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-14 11:02:07,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:07,904 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:07,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-14 11:02:07,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:07,911 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.hbase-snapshot/.tmp 2023-02-14 11:02:07,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:07,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:07,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:07,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:07,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:07,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-14 11:02:07,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:07,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:07,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:07,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676372557924 2023-02-14 11:02:07,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-14 11:02:07,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-14 11:02:07,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-14 11:02:07,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-14 11:02:07,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-14 11:02:07,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-14 11:02:07,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:07,929 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:07,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-14 11:02:07,929 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-14 11:02:07,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-14 11:02:07,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-14 11:02:07,930 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:07,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-14 11:02:07,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-14 11:02:07,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372527937,5,FailOnTimeoutGroup] 2023-02-14 11:02:07,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372527937,5,FailOnTimeoutGroup] 2023-02-14 11:02:07,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:07,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-14 11:02:07,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:07,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:07,955 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:07,956 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:07,957 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce 2023-02-14 11:02:07,972 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:07,974 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:07,975 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/info 2023-02-14 11:02:07,976 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:07,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:07,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:07,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:07,979 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:07,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:07,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:07,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/table 2023-02-14 11:02:07,982 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:07,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:07,983 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740 2023-02-14 11:02:07,983 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740 2023-02-14 11:02:07,986 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:07,987 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:07,992 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:07,993 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73389137, jitterRate=0.0935833603143692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:07,993 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:07,993 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:07,993 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:07,993 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:07,993 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:07,993 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:07,994 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:07,994 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:07,995 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:07,995 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-14 11:02:07,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-14 11:02:07,997 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-14 11:02:07,998 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-14 11:02:08,010 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(952): ClusterId : b1fb8102-dea9-4a3f-baa1-4695a5558d50 2023-02-14 11:02:08,010 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(952): ClusterId : b1fb8102-dea9-4a3f-baa1-4695a5558d50 2023-02-14 11:02:08,010 DEBUG [RS:0;jenkins-hbase4:36277] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:08,010 DEBUG [RS:1;jenkins-hbase4:46753] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:08,012 DEBUG [RS:0;jenkins-hbase4:36277] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:08,012 DEBUG [RS:0;jenkins-hbase4:36277] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:08,012 DEBUG [RS:1;jenkins-hbase4:46753] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:08,013 DEBUG [RS:1;jenkins-hbase4:46753] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:08,016 DEBUG [RS:1;jenkins-hbase4:46753] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:08,017 DEBUG [RS:0;jenkins-hbase4:36277] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:08,017 DEBUG [RS:1;jenkins-hbase4:46753] zookeeper.ReadOnlyZKClient(139): Connect 0x13ad1457 to 127.0.0.1:54770 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:08,018 DEBUG [RS:0;jenkins-hbase4:36277] zookeeper.ReadOnlyZKClient(139): Connect 0x39d379e0 to 127.0.0.1:54770 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:08,023 DEBUG [RS:1;jenkins-hbase4:46753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d6af852, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:08,023 DEBUG [RS:0;jenkins-hbase4:36277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@371480aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:08,023 DEBUG [RS:1;jenkins-hbase4:46753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19557f27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:08,023 DEBUG [RS:0;jenkins-hbase4:36277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@332b1290, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:08,034 DEBUG [RS:1;jenkins-hbase4:46753] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46753 2023-02-14 11:02:08,034 INFO [RS:1;jenkins-hbase4:46753] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:08,034 INFO [RS:1;jenkins-hbase4:46753] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:08,034 DEBUG [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:08,035 DEBUG [RS:0;jenkins-hbase4:36277] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36277 2023-02-14 11:02:08,035 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40109,1676372527540 with isa=jenkins-hbase4.apache.org/172.31.14.131:46753, startcode=1676372527678 2023-02-14 11:02:08,035 INFO [RS:0;jenkins-hbase4:36277] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:08,035 INFO [RS:0;jenkins-hbase4:36277] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:08,035 DEBUG [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:08,035 DEBUG [RS:1;jenkins-hbase4:46753] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:08,036 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40109,1676372527540 with isa=jenkins-hbase4.apache.org/172.31.14.131:36277, startcode=1676372527623 2023-02-14 11:02:08,036 DEBUG [RS:0;jenkins-hbase4:36277] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:08,041 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60793, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:08,041 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51071, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:08,043 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40109] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:08,044 DEBUG [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce 2023-02-14 11:02:08,044 DEBUG [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32885 2023-02-14 11:02:08,044 DEBUG [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:08,046 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:08,047 DEBUG [RS:0;jenkins-hbase4:36277] zookeeper.ZKUtil(162): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:08,047 WARN [RS:0;jenkins-hbase4:36277] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:08,047 INFO [RS:0;jenkins-hbase4:36277] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:08,048 DEBUG [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce 2023-02-14 11:02:08,048 DEBUG [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32885 2023-02-14 11:02:08,048 DEBUG [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:08,048 DEBUG [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/WALs/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:08,053 DEBUG [RS:1;jenkins-hbase4:46753] zookeeper.ZKUtil(162): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,054 WARN [RS:1;jenkins-hbase4:46753] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:08,054 INFO [RS:1;jenkins-hbase4:46753] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:08,054 DEBUG [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/WALs/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,057 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36277,1676372527623] 2023-02-14 11:02:08,057 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46753,1676372527678] 2023-02-14 11:02:08,065 DEBUG [RS:1;jenkins-hbase4:46753] zookeeper.ZKUtil(162): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:08,066 DEBUG [RS:1;jenkins-hbase4:46753] zookeeper.ZKUtil(162): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,066 DEBUG [RS:0;jenkins-hbase4:36277] zookeeper.ZKUtil(162): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:08,067 DEBUG [RS:1;jenkins-hbase4:46753] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:08,067 INFO [RS:1;jenkins-hbase4:46753] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:08,068 DEBUG [RS:0;jenkins-hbase4:36277] zookeeper.ZKUtil(162): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,069 DEBUG [RS:0;jenkins-hbase4:36277] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:08,069 INFO [RS:0;jenkins-hbase4:36277] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:08,074 INFO [RS:1;jenkins-hbase4:46753] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:08,081 INFO [RS:0;jenkins-hbase4:36277] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:08,081 INFO [RS:1;jenkins-hbase4:46753] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:08,081 INFO [RS:1;jenkins-hbase4:46753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,081 INFO [RS:0;jenkins-hbase4:36277] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:08,081 INFO [RS:0;jenkins-hbase4:36277] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,082 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:08,083 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:08,084 INFO [RS:1;jenkins-hbase4:46753] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,084 INFO [RS:0;jenkins-hbase4:36277] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,084 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,085 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,085 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,085 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,085 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,085 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,085 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,085 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,085 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,086 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,086 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:08,086 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:08,086 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,086 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,086 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,086 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,086 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,086 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,087 DEBUG [RS:0;jenkins-hbase4:36277] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,087 DEBUG [RS:1;jenkins-hbase4:46753] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:08,108 INFO [RS:1;jenkins-hbase4:46753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,108 INFO [RS:1;jenkins-hbase4:46753] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,108 INFO [RS:1;jenkins-hbase4:46753] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,112 INFO [RS:0;jenkins-hbase4:36277] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,112 INFO [RS:0;jenkins-hbase4:36277] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,112 INFO [RS:0;jenkins-hbase4:36277] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,128 INFO [RS:0;jenkins-hbase4:36277] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:08,129 INFO [RS:0;jenkins-hbase4:36277] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36277,1676372527623-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,130 INFO [RS:1;jenkins-hbase4:46753] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:08,130 INFO [RS:1;jenkins-hbase4:46753] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46753,1676372527678-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,149 DEBUG [jenkins-hbase4:40109] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-14 11:02:08,149 DEBUG [jenkins-hbase4:40109] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:08,151 DEBUG [jenkins-hbase4:40109] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:08,151 DEBUG [jenkins-hbase4:40109] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:08,151 DEBUG [jenkins-hbase4:40109] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:08,153 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46753,1676372527678, state=OPENING 2023-02-14 11:02:08,153 INFO [RS:1;jenkins-hbase4:46753] regionserver.Replication(203): jenkins-hbase4.apache.org,46753,1676372527678 started 2023-02-14 11:02:08,153 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46753,1676372527678, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46753, sessionid=0x100527eb3560002 2023-02-14 11:02:08,154 DEBUG [RS:1;jenkins-hbase4:46753] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:08,153 INFO [RS:0;jenkins-hbase4:36277] regionserver.Replication(203): jenkins-hbase4.apache.org,36277,1676372527623 started 2023-02-14 11:02:08,154 DEBUG [RS:1;jenkins-hbase4:46753] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,154 DEBUG [RS:1;jenkins-hbase4:46753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46753,1676372527678' 2023-02-14 11:02:08,154 DEBUG [RS:1;jenkins-hbase4:46753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:08,154 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36277,1676372527623, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36277, sessionid=0x100527eb3560001 2023-02-14 11:02:08,154 DEBUG [RS:0;jenkins-hbase4:36277] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:08,154 DEBUG [RS:0;jenkins-hbase4:36277] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:08,154 DEBUG [RS:0;jenkins-hbase4:36277] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36277,1676372527623' 2023-02-14 11:02:08,154 DEBUG [RS:0;jenkins-hbase4:36277] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:08,154 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-14 11:02:08,154 DEBUG [RS:1;jenkins-hbase4:46753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:08,155 DEBUG [RS:0;jenkins-hbase4:36277] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:08,156 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:08,156 DEBUG [RS:1;jenkins-hbase4:46753] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:08,156 DEBUG [RS:1;jenkins-hbase4:46753] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:08,156 DEBUG [RS:0;jenkins-hbase4:36277] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:08,156 DEBUG [RS:1;jenkins-hbase4:46753] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,156 DEBUG [RS:1;jenkins-hbase4:46753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46753,1676372527678' 2023-02-14 11:02:08,156 DEBUG [RS:1;jenkins-hbase4:46753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:08,156 DEBUG [RS:0;jenkins-hbase4:36277] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:08,156 DEBUG [RS:0;jenkins-hbase4:36277] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:08,156 DEBUG [RS:0;jenkins-hbase4:36277] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36277,1676372527623' 2023-02-14 11:02:08,156 DEBUG [RS:0;jenkins-hbase4:36277] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:08,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46753,1676372527678}] 2023-02-14 11:02:08,156 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:08,157 DEBUG [RS:1;jenkins-hbase4:46753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:08,159 DEBUG [RS:0;jenkins-hbase4:36277] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:08,160 DEBUG [RS:1;jenkins-hbase4:46753] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:08,161 INFO [RS:1;jenkins-hbase4:46753] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:08,161 INFO [RS:1;jenkins-hbase4:46753] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:08,180 DEBUG [RS:0;jenkins-hbase4:36277] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:08,180 INFO [RS:0;jenkins-hbase4:36277] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:08,180 INFO [RS:0;jenkins-hbase4:36277] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:08,311 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,312 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:08,315 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47646, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:08,323 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-14 11:02:08,323 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:08,324 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46753%2C1676372527678.meta, suffix=.meta, logDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/WALs/jenkins-hbase4.apache.org,46753,1676372527678, archiveDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/oldWALs, maxLogs=32 2023-02-14 11:02:08,353 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK] 2023-02-14 11:02:08,360 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK] 2023-02-14 11:02:08,363 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/WALs/jenkins-hbase4.apache.org,46753,1676372527678/jenkins-hbase4.apache.org%2C46753%2C1676372527678.meta.1676372528326.meta 2023-02-14 11:02:08,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK], DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK]] 2023-02-14 11:02:08,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:08,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-14 11:02:08,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-14 11:02:08,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-14 11:02:08,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-14 11:02:08,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:08,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-14 11:02:08,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-14 11:02:08,367 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:08,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/info 2023-02-14 11:02:08,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/info 2023-02-14 11:02:08,369 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:08,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:08,370 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:08,372 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:08,372 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:08,372 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:08,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:08,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:08,374 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/table 2023-02-14 11:02:08,374 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/table 2023-02-14 11:02:08,374 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:08,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:08,375 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740 2023-02-14 11:02:08,376 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740 2023-02-14 11:02:08,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:08,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:08,382 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63691769, jitterRate=-0.05091868340969086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:08,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:08,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676372528311 2023-02-14 11:02:08,389 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-14 11:02:08,389 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-14 11:02:08,390 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46753,1676372527678, state=OPEN 2023-02-14 11:02:08,391 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-14 11:02:08,391 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:08,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-14 11:02:08,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46753,1676372527678 in 235 msec 2023-02-14 11:02:08,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-14 11:02:08,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 399 msec 2023-02-14 11:02:08,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 485 msec 2023-02-14 11:02:08,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676372528398, completionTime=-1 2023-02-14 11:02:08,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-14 11:02:08,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-14 11:02:08,416 DEBUG [hconnection-0x698861a8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:08,419 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47654, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:08,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-14 11:02:08,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676372588422 2023-02-14 11:02:08,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676372648422 2023-02-14 11:02:08,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 23 msec 2023-02-14 11:02:08,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40109,1676372527540-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40109,1676372527540-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40109,1676372527540-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40109, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:08,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-14 11:02:08,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:08,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-14 11:02:08,455 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-14 11:02:08,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:08,456 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:08,458 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:08,459 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0 empty. 2023-02-14 11:02:08,459 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:08,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-14 11:02:08,479 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:08,481 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 94b54c92417b13a60dac4e1954a416d0, NAME => 'hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:08,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:08,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 94b54c92417b13a60dac4e1954a416d0, disabling compactions & flushes 2023-02-14 11:02:08,502 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:08,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:08,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. after waiting 0 ms 2023-02-14 11:02:08,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:08,502 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:08,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 94b54c92417b13a60dac4e1954a416d0: 2023-02-14 11:02:08,505 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:08,506 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372528506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372528506"}]},"ts":"1676372528506"} 2023-02-14 11:02:08,510 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:08,511 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:08,511 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372528511"}]},"ts":"1676372528511"} 2023-02-14 11:02:08,513 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-14 11:02:08,517 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:08,517 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:08,517 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:08,518 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:08,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=94b54c92417b13a60dac4e1954a416d0, ASSIGN}] 2023-02-14 11:02:08,521 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=94b54c92417b13a60dac4e1954a416d0, ASSIGN 2023-02-14 11:02:08,522 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=94b54c92417b13a60dac4e1954a416d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46753,1676372527678; forceNewPlan=false, retain=false 2023-02-14 11:02:08,672 INFO [jenkins-hbase4:40109] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:08,674 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=94b54c92417b13a60dac4e1954a416d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,674 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372528673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372528673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372528673"}]},"ts":"1676372528673"} 2023-02-14 11:02:08,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 94b54c92417b13a60dac4e1954a416d0, server=jenkins-hbase4.apache.org,46753,1676372527678}] 2023-02-14 11:02:08,833 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:08,834 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46753%2C1676372527678, suffix=, logDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/WALs/jenkins-hbase4.apache.org,46753,1676372527678, archiveDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/oldWALs, maxLogs=32 2023-02-14 11:02:08,854 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK] 2023-02-14 11:02:08,855 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK] 2023-02-14 11:02:08,857 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/WALs/jenkins-hbase4.apache.org,46753,1676372527678/jenkins-hbase4.apache.org%2C46753%2C1676372527678.1676372528835 2023-02-14 11:02:08,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK], DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK]] 2023-02-14 11:02:08,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 94b54c92417b13a60dac4e1954a416d0, NAME => 'hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:08,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:08,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:08,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:08,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:08,860 INFO [StoreOpener-94b54c92417b13a60dac4e1954a416d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:08,861 DEBUG [StoreOpener-94b54c92417b13a60dac4e1954a416d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0/info 2023-02-14 11:02:08,861 DEBUG [StoreOpener-94b54c92417b13a60dac4e1954a416d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0/info 2023-02-14 11:02:08,862 INFO [StoreOpener-94b54c92417b13a60dac4e1954a416d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94b54c92417b13a60dac4e1954a416d0 columnFamilyName info 2023-02-14 11:02:08,862 INFO [StoreOpener-94b54c92417b13a60dac4e1954a416d0-1] regionserver.HStore(310): Store=94b54c92417b13a60dac4e1954a416d0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:08,863 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:08,863 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:08,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:08,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:08,872 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 94b54c92417b13a60dac4e1954a416d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74249666, jitterRate=0.10640624165534973}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:08,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 94b54c92417b13a60dac4e1954a416d0: 2023-02-14 11:02:08,873 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0., pid=6, masterSystemTime=1676372528829 2023-02-14 11:02:08,876 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:08,876 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:08,877 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=94b54c92417b13a60dac4e1954a416d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:08,877 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372528877"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372528877"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372528877"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372528877"}]},"ts":"1676372528877"} 2023-02-14 11:02:08,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-14 11:02:08,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 94b54c92417b13a60dac4e1954a416d0, server=jenkins-hbase4.apache.org,46753,1676372527678 in 203 msec 2023-02-14 11:02:08,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-14 11:02:08,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=94b54c92417b13a60dac4e1954a416d0, ASSIGN in 366 msec 2023-02-14 11:02:08,886 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:08,887 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372528887"}]},"ts":"1676372528887"} 2023-02-14 11:02:08,888 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-14 11:02:08,891 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:08,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 460 msec 2023-02-14 11:02:08,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-14 11:02:08,985 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:08,985 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:09,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-14 11:02:09,047 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:09,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 84 msec 2023-02-14 11:02:09,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-14 11:02:09,138 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:09,182 INFO [RS:0;jenkins-hbase4:36277] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36277%2C1676372527623, suffix=, logDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/WALs/jenkins-hbase4.apache.org,36277,1676372527623, archiveDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/oldWALs, maxLogs=32 2023-02-14 11:02:09,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 99 msec 2023-02-14 11:02:09,204 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK] 2023-02-14 11:02:09,204 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK] 2023-02-14 11:02:09,208 INFO [RS:0;jenkins-hbase4:36277] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/WALs/jenkins-hbase4.apache.org,36277,1676372527623/jenkins-hbase4.apache.org%2C36277%2C1676372527623.1676372529183 2023-02-14 11:02:09,212 DEBUG [RS:0;jenkins-hbase4:36277] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK], DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK]] 2023-02-14 11:02:09,346 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-14 11:02:09,454 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-14 11:02:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.735sec 2023-02-14 11:02:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-14 11:02:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-14 11:02:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-14 11:02:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40109,1676372527540-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-14 11:02:09,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40109,1676372527540-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-14 11:02:09,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-14 11:02:09,511 DEBUG [Listener at localhost/41749] zookeeper.ReadOnlyZKClient(139): Connect 0x7ecc4d24 to 127.0.0.1:54770 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:09,562 DEBUG [Listener at localhost/41749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@521aec37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:09,564 DEBUG [hconnection-0x64ae4e2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:09,567 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47662, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:09,569 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:09,569 DEBUG [Listener at localhost/41749] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-14 11:02:09,570 DEBUG [Listener at localhost/41749] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-14 11:02:09,572 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45334, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-14 11:02:09,573 INFO [Listener at localhost/41749] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-14 11:02:09,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-14 11:02:09,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-14 11:02:09,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:45334 deadline: 1676372589573, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-14 11:02:09,574 INFO [Listener at localhost/41749] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-14 11:02:09,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:09,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-14 11:02:09,579 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:09,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-14 11:02:09,580 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:09,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:09,588 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:09,588 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:09,588 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:09,588 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:09,588 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:09,588 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/a6edd594895698de5605457161632837 2023-02-14 11:02:09,588 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:09,588 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:09,589 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c empty. 2023-02-14 11:02:09,589 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c empty. 2023-02-14 11:02:09,589 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90 empty. 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:09,589 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67 empty. 2023-02-14 11:02:09,589 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd empty. 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/a6edd594895698de5605457161632837 empty. 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429 empty. 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480 empty. 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:09,590 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/a6edd594895698de5605457161632837 2023-02-14 11:02:09,591 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6 empty. 2023-02-14 11:02:09,591 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:09,591 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba empty. 2023-02-14 11:02:09,591 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:09,591 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:09,591 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-14 11:02:09,601 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:09,602 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 00b4cdc10938611b392f2d51bf4c3a67, NAME => 'testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,603 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 38db420affeb6e2972189e2494e70bfd, NAME => 'testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,603 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3eed5453f8018cf240a595f4184b5b4c, NAME => 'testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 38db420affeb6e2972189e2494e70bfd, disabling compactions & flushes 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:09,615 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 00b4cdc10938611b392f2d51bf4c3a67, disabling compactions & flushes 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:09,615 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. after waiting 0 ms 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:09,615 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:09,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3eed5453f8018cf240a595f4184b5b4c, disabling compactions & flushes 2023-02-14 11:02:09,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 38db420affeb6e2972189e2494e70bfd: 2023-02-14 11:02:09,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. after waiting 1 ms 2023-02-14 11:02:09,616 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:09,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:09,616 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:09,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 00b4cdc10938611b392f2d51bf4c3a67: 2023-02-14 11:02:09,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:09,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. after waiting 0 ms 2023-02-14 11:02:09,616 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a6edd594895698de5605457161632837, NAME => 'testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,616 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4df9a62258c4abdc44dd57c5241dd480, NAME => 'testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:09,617 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:09,617 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3eed5453f8018cf240a595f4184b5b4c: 2023-02-14 11:02:09,617 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => face03591dcef4ef3d6e6d4b5fc0c429, NAME => 'testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,630 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:09,631 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a6edd594895698de5605457161632837, disabling compactions & flushes 2023-02-14 11:02:09,631 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:09,631 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:09,631 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. after waiting 0 ms 2023-02-14 11:02:09,631 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:09,631 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:09,631 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a6edd594895698de5605457161632837: 2023-02-14 11:02:09,631 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => d7f71608b7ab02bc78e2a9ba466c6b90, NAME => 'testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,631 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:09,632 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing face03591dcef4ef3d6e6d4b5fc0c429, disabling compactions & flushes 2023-02-14 11:02:09,632 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:09,632 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:09,632 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. after waiting 0 ms 2023-02-14 11:02:09,632 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:09,632 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:09,632 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for face03591dcef4ef3d6e6d4b5fc0c429: 2023-02-14 11:02:09,632 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b2c08b25d72243932e8b9f08d12c111c, NAME => 'testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,640 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:09,640 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing d7f71608b7ab02bc78e2a9ba466c6b90, disabling compactions & flushes 2023-02-14 11:02:09,640 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:09,640 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:09,640 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. after waiting 0 ms 2023-02-14 11:02:09,640 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:09,640 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:09,640 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for d7f71608b7ab02bc78e2a9ba466c6b90: 2023-02-14 11:02:09,641 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2b9b47d15cdb50b28b74e69ecd7b07e6, NAME => 'testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,643 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:09,643 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b2c08b25d72243932e8b9f08d12c111c, disabling compactions & flushes 2023-02-14 11:02:09,643 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:09,643 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:09,643 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. after waiting 0 ms 2023-02-14 11:02:09,643 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:09,643 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:09,643 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b2c08b25d72243932e8b9f08d12c111c: 2023-02-14 11:02:09,643 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4043ad074064f04c99a556c4ccb426ba, NAME => 'testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.tmp 2023-02-14 11:02:09,648 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:09,648 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 2b9b47d15cdb50b28b74e69ecd7b07e6, disabling compactions & flushes 2023-02-14 11:02:09,648 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:09,648 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:09,648 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. after waiting 0 ms 2023-02-14 11:02:09,649 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:09,649 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:09,649 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 2b9b47d15cdb50b28b74e69ecd7b07e6: 2023-02-14 11:02:09,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:09,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4043ad074064f04c99a556c4ccb426ba, disabling compactions & flushes 2023-02-14 11:02:09,651 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:09,651 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:09,651 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. after waiting 0 ms 2023-02-14 11:02:09,651 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:09,651 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:09,651 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4043ad074064f04c99a556c4ccb426ba: 2023-02-14 11:02:09,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:09,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:10,031 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,031 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4df9a62258c4abdc44dd57c5241dd480, disabling compactions & flushes 2023-02-14 11:02:10,031 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:10,031 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:10,031 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. after waiting 0 ms 2023-02-14 11:02:10,031 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:10,032 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:10,032 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4df9a62258c4abdc44dd57c5241dd480: 2023-02-14 11:02:10,034 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:10,035 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,035 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,035 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676372529576.a6edd594895698de5605457161632837.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372530035"}]},"ts":"1676372530035"} 2023-02-14 11:02:10,038 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-14 11:02:10,039 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:10,040 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372530039"}]},"ts":"1676372530039"} 2023-02-14 11:02:10,041 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-14 11:02:10,184 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:10,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:10,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:10,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:10,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:10,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3eed5453f8018cf240a595f4184b5b4c, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=38db420affeb6e2972189e2494e70bfd, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=00b4cdc10938611b392f2d51bf4c3a67, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4df9a62258c4abdc44dd57c5241dd480, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a6edd594895698de5605457161632837, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=face03591dcef4ef3d6e6d4b5fc0c429, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d7f71608b7ab02bc78e2a9ba466c6b90, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b2c08b25d72243932e8b9f08d12c111c, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2b9b47d15cdb50b28b74e69ecd7b07e6, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4043ad074064f04c99a556c4ccb426ba, ASSIGN}] 2023-02-14 11:02:10,196 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4043ad074064f04c99a556c4ccb426ba, ASSIGN 2023-02-14 11:02:10,197 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2b9b47d15cdb50b28b74e69ecd7b07e6, ASSIGN 2023-02-14 11:02:10,197 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b2c08b25d72243932e8b9f08d12c111c, ASSIGN 2023-02-14 11:02:10,197 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d7f71608b7ab02bc78e2a9ba466c6b90, ASSIGN 2023-02-14 11:02:10,197 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=face03591dcef4ef3d6e6d4b5fc0c429, ASSIGN 2023-02-14 11:02:10,197 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4043ad074064f04c99a556c4ccb426ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46753,1676372527678; forceNewPlan=false, retain=false 2023-02-14 11:02:10,197 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b2c08b25d72243932e8b9f08d12c111c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46753,1676372527678; forceNewPlan=false, retain=false 2023-02-14 11:02:10,197 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2b9b47d15cdb50b28b74e69ecd7b07e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36277,1676372527623; forceNewPlan=false, retain=false 2023-02-14 11:02:10,198 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d7f71608b7ab02bc78e2a9ba466c6b90, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36277,1676372527623; forceNewPlan=false, retain=false 2023-02-14 11:02:10,198 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4df9a62258c4abdc44dd57c5241dd480, ASSIGN 2023-02-14 11:02:10,198 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=face03591dcef4ef3d6e6d4b5fc0c429, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46753,1676372527678; forceNewPlan=false, retain=false 2023-02-14 11:02:10,198 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a6edd594895698de5605457161632837, ASSIGN 2023-02-14 11:02:10,199 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=00b4cdc10938611b392f2d51bf4c3a67, ASSIGN 2023-02-14 11:02:10,199 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=38db420affeb6e2972189e2494e70bfd, ASSIGN 2023-02-14 11:02:10,199 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3eed5453f8018cf240a595f4184b5b4c, ASSIGN 2023-02-14 11:02:10,199 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4df9a62258c4abdc44dd57c5241dd480, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36277,1676372527623; forceNewPlan=false, retain=false 2023-02-14 11:02:10,199 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a6edd594895698de5605457161632837, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36277,1676372527623; forceNewPlan=false, retain=false 2023-02-14 11:02:10,199 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=00b4cdc10938611b392f2d51bf4c3a67, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36277,1676372527623; forceNewPlan=false, retain=false 2023-02-14 11:02:10,200 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=38db420affeb6e2972189e2494e70bfd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46753,1676372527678; forceNewPlan=false, retain=false 2023-02-14 11:02:10,200 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3eed5453f8018cf240a595f4184b5b4c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46753,1676372527678; forceNewPlan=false, retain=false 2023-02-14 11:02:10,348 INFO [jenkins-hbase4:40109] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-14 11:02:10,351 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=b2c08b25d72243932e8b9f08d12c111c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,351 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4043ad074064f04c99a556c4ccb426ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,351 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=38db420affeb6e2972189e2494e70bfd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,351 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3eed5453f8018cf240a595f4184b5b4c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,351 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372530351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530351"}]},"ts":"1676372530351"} 2023-02-14 11:02:10,351 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=face03591dcef4ef3d6e6d4b5fc0c429, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,352 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372530351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530351"}]},"ts":"1676372530351"} 2023-02-14 11:02:10,352 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530351"}]},"ts":"1676372530351"} 2023-02-14 11:02:10,351 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530351"}]},"ts":"1676372530351"} 2023-02-14 11:02:10,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530351"}]},"ts":"1676372530351"} 2023-02-14 11:02:10,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 4043ad074064f04c99a556c4ccb426ba, server=jenkins-hbase4.apache.org,46753,1676372527678}] 2023-02-14 11:02:10,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure 3eed5453f8018cf240a595f4184b5b4c, server=jenkins-hbase4.apache.org,46753,1676372527678}] 2023-02-14 11:02:10,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 38db420affeb6e2972189e2494e70bfd, server=jenkins-hbase4.apache.org,46753,1676372527678}] 2023-02-14 11:02:10,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure b2c08b25d72243932e8b9f08d12c111c, server=jenkins-hbase4.apache.org,46753,1676372527678}] 2023-02-14 11:02:10,358 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=16, state=RUNNABLE; OpenRegionProcedure face03591dcef4ef3d6e6d4b5fc0c429, server=jenkins-hbase4.apache.org,46753,1676372527678}] 2023-02-14 11:02:10,360 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a6edd594895698de5605457161632837, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,360 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676372529576.a6edd594895698de5605457161632837.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530359"}]},"ts":"1676372530359"} 2023-02-14 11:02:10,361 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=00b4cdc10938611b392f2d51bf4c3a67, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,361 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530361"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530361"}]},"ts":"1676372530361"} 2023-02-14 11:02:10,363 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=2b9b47d15cdb50b28b74e69ecd7b07e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,363 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530363"}]},"ts":"1676372530363"} 2023-02-14 11:02:10,363 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4df9a62258c4abdc44dd57c5241dd480, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,364 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530363"}]},"ts":"1676372530363"} 2023-02-14 11:02:10,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 00b4cdc10938611b392f2d51bf4c3a67, server=jenkins-hbase4.apache.org,36277,1676372527623}] 2023-02-14 11:02:10,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure a6edd594895698de5605457161632837, server=jenkins-hbase4.apache.org,36277,1676372527623}] 2023-02-14 11:02:10,366 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d7f71608b7ab02bc78e2a9ba466c6b90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,366 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372530366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372530366"}]},"ts":"1676372530366"} 2023-02-14 11:02:10,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 2b9b47d15cdb50b28b74e69ecd7b07e6, server=jenkins-hbase4.apache.org,36277,1676372527623}] 2023-02-14 11:02:10,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure 4df9a62258c4abdc44dd57c5241dd480, server=jenkins-hbase4.apache.org,36277,1676372527623}] 2023-02-14 11:02:10,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure d7f71608b7ab02bc78e2a9ba466c6b90, server=jenkins-hbase4.apache.org,36277,1676372527623}] 2023-02-14 11:02:10,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:10,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b2c08b25d72243932e8b9f08d12c111c, NAME => 'testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-14 11:02:10,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:10,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:10,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:10,512 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:10,514 DEBUG [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1 2023-02-14 11:02:10,514 DEBUG [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1 2023-02-14 11:02:10,514 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2c08b25d72243932e8b9f08d12c111c columnFamilyName f1 2023-02-14 11:02:10,515 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(310): Store=b2c08b25d72243932e8b9f08d12c111c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,515 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:10,517 DEBUG [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2 2023-02-14 11:02:10,517 DEBUG [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2 2023-02-14 11:02:10,517 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,517 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:10,517 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2c08b25d72243932e8b9f08d12c111c columnFamilyName f2 2023-02-14 11:02:10,518 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(310): Store=b2c08b25d72243932e8b9f08d12c111c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:10,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:10,521 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:10,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:10,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:10,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2b9b47d15cdb50b28b74e69ecd7b07e6, NAME => 'testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-14 11:02:10,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:10,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:10,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:10,526 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:10,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b2c08b25d72243932e8b9f08d12c111c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68071797, jitterRate=0.014348819851875305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b2c08b25d72243932e8b9f08d12c111c: 2023-02-14 11:02:10,528 DEBUG [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1 2023-02-14 11:02:10,528 DEBUG [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1 2023-02-14 11:02:10,528 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b9b47d15cdb50b28b74e69ecd7b07e6 columnFamilyName f1 2023-02-14 11:02:10,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c., pid=24, masterSystemTime=1676372530507 2023-02-14 11:02:10,529 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(310): Store=2b9b47d15cdb50b28b74e69ecd7b07e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,529 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:10,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:10,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:10,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => face03591dcef4ef3d6e6d4b5fc0c429, NAME => 'testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-14 11:02:10,531 DEBUG [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2 2023-02-14 11:02:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:10,531 DEBUG [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2 2023-02-14 11:02:10,531 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=b2c08b25d72243932e8b9f08d12c111c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:10,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:10,531 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530531"}]},"ts":"1676372530531"} 2023-02-14 11:02:10,531 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b9b47d15cdb50b28b74e69ecd7b07e6 columnFamilyName f2 2023-02-14 11:02:10,532 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(310): Store=2b9b47d15cdb50b28b74e69ecd7b07e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,532 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:10,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:10,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-14 11:02:10,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure b2c08b25d72243932e8b9f08d12c111c, server=jenkins-hbase4.apache.org,46753,1676372527678 in 176 msec 2023-02-14 11:02:10,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:10,536 DEBUG [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1 2023-02-14 11:02:10,536 DEBUG [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1 2023-02-14 11:02:10,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b2c08b25d72243932e8b9f08d12c111c, ASSIGN in 341 msec 2023-02-14 11:02:10,536 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region face03591dcef4ef3d6e6d4b5fc0c429 columnFamilyName f1 2023-02-14 11:02:10,537 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(310): Store=face03591dcef4ef3d6e6d4b5fc0c429/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,537 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:10,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,538 DEBUG [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2 2023-02-14 11:02:10,538 DEBUG [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2 2023-02-14 11:02:10,539 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region face03591dcef4ef3d6e6d4b5fc0c429 columnFamilyName f2 2023-02-14 11:02:10,539 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(310): Store=face03591dcef4ef3d6e6d4b5fc0c429/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:10,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:10,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:10,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2b9b47d15cdb50b28b74e69ecd7b07e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65352741, jitterRate=-0.026168271899223328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2b9b47d15cdb50b28b74e69ecd7b07e6: 2023-02-14 11:02:10,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6., pid=28, masterSystemTime=1676372530517 2023-02-14 11:02:10,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:10,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:10,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:10,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:10,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a6edd594895698de5605457161632837, NAME => 'testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-14 11:02:10,547 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=2b9b47d15cdb50b28b74e69ecd7b07e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a6edd594895698de5605457161632837 2023-02-14 11:02:10,548 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530547"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530547"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530547"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530547"}]},"ts":"1676372530547"} 2023-02-14 11:02:10,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a6edd594895698de5605457161632837 2023-02-14 11:02:10,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a6edd594895698de5605457161632837 2023-02-14 11:02:10,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened face03591dcef4ef3d6e6d4b5fc0c429; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62334386, jitterRate=-0.07114526629447937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for face03591dcef4ef3d6e6d4b5fc0c429: 2023-02-14 11:02:10,549 INFO [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a6edd594895698de5605457161632837 2023-02-14 11:02:10,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429., pid=25, masterSystemTime=1676372530507 2023-02-14 11:02:10,550 DEBUG [StoreOpener-a6edd594895698de5605457161632837-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1 2023-02-14 11:02:10,550 DEBUG [StoreOpener-a6edd594895698de5605457161632837-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1 2023-02-14 11:02:10,551 INFO [StoreOpener-a6edd594895698de5605457161632837-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6edd594895698de5605457161632837 columnFamilyName f1 2023-02-14 11:02:10,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:10,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:10,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:10,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 38db420affeb6e2972189e2494e70bfd, NAME => 'testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-14 11:02:10,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-14 11:02:10,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 2b9b47d15cdb50b28b74e69ecd7b07e6, server=jenkins-hbase4.apache.org,36277,1676372527623 in 182 msec 2023-02-14 11:02:10,551 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=face03591dcef4ef3d6e6d4b5fc0c429, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:10,551 INFO [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(310): Store=a6edd594895698de5605457161632837/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,552 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530551"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530551"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530551"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530551"}]},"ts":"1676372530551"} 2023-02-14 11:02:10,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,552 INFO [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a6edd594895698de5605457161632837 2023-02-14 11:02:10,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:10,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:10,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2b9b47d15cdb50b28b74e69ecd7b07e6, ASSIGN in 357 msec 2023-02-14 11:02:10,553 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:10,554 DEBUG [StoreOpener-a6edd594895698de5605457161632837-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2 2023-02-14 11:02:10,554 DEBUG [StoreOpener-a6edd594895698de5605457161632837-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2 2023-02-14 11:02:10,554 INFO [StoreOpener-a6edd594895698de5605457161632837-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6edd594895698de5605457161632837 columnFamilyName f2 2023-02-14 11:02:10,555 INFO [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(310): Store=a6edd594895698de5605457161632837/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=16 2023-02-14 11:02:10,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=16, state=SUCCESS; OpenRegionProcedure face03591dcef4ef3d6e6d4b5fc0c429, server=jenkins-hbase4.apache.org,46753,1676372527678 in 195 msec 2023-02-14 11:02:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837 2023-02-14 11:02:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837 2023-02-14 11:02:10,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=face03591dcef4ef3d6e6d4b5fc0c429, ASSIGN in 361 msec 2023-02-14 11:02:10,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a6edd594895698de5605457161632837 2023-02-14 11:02:10,560 DEBUG [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1 2023-02-14 11:02:10,560 DEBUG [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1 2023-02-14 11:02:10,560 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38db420affeb6e2972189e2494e70bfd columnFamilyName f1 2023-02-14 11:02:10,561 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(310): Store=38db420affeb6e2972189e2494e70bfd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,561 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:10,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a6edd594895698de5605457161632837; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73651782, jitterRate=0.09749707579612732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a6edd594895698de5605457161632837: 2023-02-14 11:02:10,562 DEBUG [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2 2023-02-14 11:02:10,562 DEBUG [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2 2023-02-14 11:02:10,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837., pid=27, masterSystemTime=1676372530517 2023-02-14 11:02:10,563 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38db420affeb6e2972189e2494e70bfd columnFamilyName f2 2023-02-14 11:02:10,563 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(310): Store=38db420affeb6e2972189e2494e70bfd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:10,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:10,565 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a6edd594895698de5605457161632837, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,565 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676372529576.a6edd594895698de5605457161632837.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530564"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530564"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530564"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530564"}]},"ts":"1676372530564"} 2023-02-14 11:02:10,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:10,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:10,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:10,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 00b4cdc10938611b392f2d51bf4c3a67, NAME => 'testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-14 11:02:10,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:10,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:10,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:10,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,568 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:10,569 DEBUG [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1 2023-02-14 11:02:10,569 DEBUG [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1 2023-02-14 11:02:10,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:10,570 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00b4cdc10938611b392f2d51bf4c3a67 columnFamilyName f1 2023-02-14 11:02:10,571 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(310): Store=00b4cdc10938611b392f2d51bf4c3a67/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,571 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:10,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-14 11:02:10,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure a6edd594895698de5605457161632837, server=jenkins-hbase4.apache.org,36277,1676372527623 in 202 msec 2023-02-14 11:02:10,573 DEBUG [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2 2023-02-14 11:02:10,573 DEBUG [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2 2023-02-14 11:02:10,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,573 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00b4cdc10938611b392f2d51bf4c3a67 columnFamilyName f2 2023-02-14 11:02:10,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 38db420affeb6e2972189e2494e70bfd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74119819, jitterRate=0.1044713705778122}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 38db420affeb6e2972189e2494e70bfd: 2023-02-14 11:02:10,574 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(310): Store=00b4cdc10938611b392f2d51bf4c3a67/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd., pid=23, masterSystemTime=1676372530507 2023-02-14 11:02:10,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:10,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a6edd594895698de5605457161632837, ASSIGN in 378 msec 2023-02-14 11:02:10,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:10,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:10,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:10,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:10,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4043ad074064f04c99a556c4ccb426ba, NAME => 'testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-14 11:02:10,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=38db420affeb6e2972189e2494e70bfd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:10,577 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530577"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530577"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530577"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530577"}]},"ts":"1676372530577"} 2023-02-14 11:02:10,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:10,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:10,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,579 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:10,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:10,581 DEBUG [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba/f1 2023-02-14 11:02:10,581 DEBUG [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba/f1 2023-02-14 11:02:10,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-14 11:02:10,581 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4043ad074064f04c99a556c4ccb426ba columnFamilyName f1 2023-02-14 11:02:10,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 38db420affeb6e2972189e2494e70bfd, server=jenkins-hbase4.apache.org,46753,1676372527678 in 224 msec 2023-02-14 11:02:10,582 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] regionserver.HStore(310): Store=4043ad074064f04c99a556c4ccb426ba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,582 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:10,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=38db420affeb6e2972189e2494e70bfd, ASSIGN in 388 msec 2023-02-14 11:02:10,584 DEBUG [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba/f2 2023-02-14 11:02:10,584 DEBUG [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba/f2 2023-02-14 11:02:10,584 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4043ad074064f04c99a556c4ccb426ba columnFamilyName f2 2023-02-14 11:02:10,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,585 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] regionserver.HStore(310): Store=4043ad074064f04c99a556c4ccb426ba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 00b4cdc10938611b392f2d51bf4c3a67; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68084846, jitterRate=0.014543265104293823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 00b4cdc10938611b392f2d51bf4c3a67: 2023-02-14 11:02:10,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67., pid=26, masterSystemTime=1676372530517 2023-02-14 11:02:10,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:10,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:10,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:10,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d7f71608b7ab02bc78e2a9ba466c6b90, NAME => 'testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-14 11:02:10,588 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=00b4cdc10938611b392f2d51bf4c3a67, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:10,588 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530588"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530588"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530588"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530588"}]},"ts":"1676372530588"} 2023-02-14 11:02:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:10,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:10,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:10,590 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:10,592 DEBUG [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1 2023-02-14 11:02:10,592 DEBUG [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1 2023-02-14 11:02:10,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-14 11:02:10,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 00b4cdc10938611b392f2d51bf4c3a67, server=jenkins-hbase4.apache.org,36277,1676372527623 in 226 msec 2023-02-14 11:02:10,593 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7f71608b7ab02bc78e2a9ba466c6b90 columnFamilyName f1 2023-02-14 11:02:10,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4043ad074064f04c99a556c4ccb426ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64068261, jitterRate=-0.045308515429496765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4043ad074064f04c99a556c4ccb426ba: 2023-02-14 11:02:10,593 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(310): Store=d7f71608b7ab02bc78e2a9ba466c6b90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,593 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:10,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba., pid=21, masterSystemTime=1676372530507 2023-02-14 11:02:10,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=00b4cdc10938611b392f2d51bf4c3a67, ASSIGN in 399 msec 2023-02-14 11:02:10,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:10,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:10,596 DEBUG [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2 2023-02-14 11:02:10,596 DEBUG [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2 2023-02-14 11:02:10,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:10,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3eed5453f8018cf240a595f4184b5b4c, NAME => 'testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-14 11:02:10,596 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4043ad074064f04c99a556c4ccb426ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,596 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7f71608b7ab02bc78e2a9ba466c6b90 columnFamilyName f2 2023-02-14 11:02:10,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:10,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,597 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372530596"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530596"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530596"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530596"}]},"ts":"1676372530596"} 2023-02-14 11:02:10,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:10,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:10,597 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(310): Store=d7f71608b7ab02bc78e2a9ba466c6b90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:10,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:10,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-14 11:02:10,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 4043ad074064f04c99a556c4ccb426ba, server=jenkins-hbase4.apache.org,46753,1676372527678 in 245 msec 2023-02-14 11:02:10,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4043ad074064f04c99a556c4ccb426ba, ASSIGN in 407 msec 2023-02-14 11:02:10,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:10,604 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:10,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d7f71608b7ab02bc78e2a9ba466c6b90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58908342, jitterRate=-0.12219730019569397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d7f71608b7ab02bc78e2a9ba466c6b90: 2023-02-14 11:02:10,606 DEBUG [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c/f1 2023-02-14 11:02:10,606 DEBUG [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c/f1 2023-02-14 11:02:10,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90., pid=30, masterSystemTime=1676372530517 2023-02-14 11:02:10,606 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eed5453f8018cf240a595f4184b5b4c columnFamilyName f1 2023-02-14 11:02:10,607 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] regionserver.HStore(310): Store=3eed5453f8018cf240a595f4184b5b4c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,607 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:10,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:10,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:10,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:10,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4df9a62258c4abdc44dd57c5241dd480, NAME => 'testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-14 11:02:10,609 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d7f71608b7ab02bc78e2a9ba466c6b90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,609 DEBUG [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c/f2 2023-02-14 11:02:10,609 DEBUG [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c/f2 2023-02-14 11:02:10,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:10,609 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530609"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530609"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530609"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530609"}]},"ts":"1676372530609"} 2023-02-14 11:02:10,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:10,609 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eed5453f8018cf240a595f4184b5b4c columnFamilyName f2 2023-02-14 11:02:10,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:10,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:10,611 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:10,612 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] regionserver.HStore(310): Store=3eed5453f8018cf240a595f4184b5b4c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:10,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-14 11:02:10,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure d7f71608b7ab02bc78e2a9ba466c6b90, server=jenkins-hbase4.apache.org,36277,1676372527623 in 243 msec 2023-02-14 11:02:10,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:10,614 DEBUG [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1 2023-02-14 11:02:10,614 DEBUG [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1 2023-02-14 11:02:10,615 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4df9a62258c4abdc44dd57c5241dd480 columnFamilyName f1 2023-02-14 11:02:10,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d7f71608b7ab02bc78e2a9ba466c6b90, ASSIGN in 420 msec 2023-02-14 11:02:10,615 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(310): Store=4df9a62258c4abdc44dd57c5241dd480/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,615 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:10,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,617 DEBUG [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2 2023-02-14 11:02:10,617 DEBUG [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2 2023-02-14 11:02:10,617 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4df9a62258c4abdc44dd57c5241dd480 columnFamilyName f2 2023-02-14 11:02:10,618 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(310): Store=4df9a62258c4abdc44dd57c5241dd480/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:10,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:10,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:10,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:10,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3eed5453f8018cf240a595f4184b5b4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73727183, jitterRate=0.09862063825130463}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3eed5453f8018cf240a595f4184b5b4c: 2023-02-14 11:02:10,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:10,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c., pid=22, masterSystemTime=1676372530507 2023-02-14 11:02:10,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:10,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:10,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:10,624 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3eed5453f8018cf240a595f4184b5b4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:10,624 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676372530624"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530624"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530624"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530624"}]},"ts":"1676372530624"} 2023-02-14 11:02:10,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:10,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4df9a62258c4abdc44dd57c5241dd480; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73368039, jitterRate=0.0932689756155014}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:10,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4df9a62258c4abdc44dd57c5241dd480: 2023-02-14 11:02:10,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480., pid=29, masterSystemTime=1676372530517 2023-02-14 11:02:10,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-14 11:02:10,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure 3eed5453f8018cf240a595f4184b5b4c, server=jenkins-hbase4.apache.org,46753,1676372527678 in 271 msec 2023-02-14 11:02:10,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:10,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:10,629 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4df9a62258c4abdc44dd57c5241dd480, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:10,629 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676372530629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372530629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372530629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372530629"}]},"ts":"1676372530629"} 2023-02-14 11:02:10,630 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3eed5453f8018cf240a595f4184b5b4c, ASSIGN in 435 msec 2023-02-14 11:02:10,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-14 11:02:10,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure 4df9a62258c4abdc44dd57c5241dd480, server=jenkins-hbase4.apache.org,36277,1676372527623 in 264 msec 2023-02-14 11:02:10,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-14 11:02:10,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4df9a62258c4abdc44dd57c5241dd480, ASSIGN in 438 msec 2023-02-14 11:02:10,634 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:10,635 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372530634"}]},"ts":"1676372530634"} 2023-02-14 11:02:10,636 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-14 11:02:10,670 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:10,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.0940 sec 2023-02-14 11:02:10,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:10,688 INFO [Listener at localhost/41749] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-14 11:02:10,688 DEBUG [Listener at localhost/41749] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-14 11:02:10,688 INFO [Listener at localhost/41749] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:10,692 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-14 11:02:10,692 INFO [Listener at localhost/41749] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:10,692 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-14 11:02:10,692 INFO [Listener at localhost/41749] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-14 11:02:10,718 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-14 11:02:10,768 DEBUG [hconnection-0x64ae4e2-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:10,792 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46753] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:10,796 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:10,808 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36277] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:10,912 INFO [Listener at localhost/41749] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-14 11:02:10,912 INFO [Listener at localhost/41749] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-14 11:02:10,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-14 11:02:10,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676372530913 (current time:1676372530913). 2023-02-14 11:02:10,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-14 11:02:10,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] zookeeper.ReadOnlyZKClient(139): Connect 0x442c4cf0 to 127.0.0.1:54770 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:10,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@503b7db8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:10,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:10,967 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:10,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x442c4cf0 to 127.0.0.1:54770 2023-02-14 11:02:10,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:10,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-14 11:02:10,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-14 11:02:10,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-14 11:02:10,972 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-14 11:02:10,973 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676373130973 2023-02-14 11:02:10,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-14 11:02:10,973 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-14 11:02:10,974 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:10,974 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-14 11:02:10,974 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-14 11:02:10,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-14 11:02:10,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-14 11:02:10,976 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-14 11:02:10,977 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676373130977 2023-02-14 11:02:10,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:10,990 INFO [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-14 11:02:10,990 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:10,991 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-14 11:02:10,991 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-14 11:02:11,031 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,031 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,075 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:11,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:02:11,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:11,077 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-14 11:02:11,077 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,077 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:11,077 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:11,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:11,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:11,077 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,077 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,078 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,078 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,079 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-14 11:02:11,079 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:11,079 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-14 11:02:11,079 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-14 11:02:11,079 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:11,080 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-14 11:02:11,080 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46753,1676372527678' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-14 11:02:11,080 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-14 11:02:11,080 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-14 11:02:11,080 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36277,1676372527623' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-14 11:02:11,154 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,154 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,154 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,154 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:11,154 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,154 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:11,154 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,154 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:11,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:11,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:11,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46753,1676372527678' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-14 11:02:11,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14946d7a[Count = 1] remaining members to acquire global barrier 2023-02-14 11:02:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:11,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36277,1676372527623' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-14 11:02:11,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14946d7a[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:11,159 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-14 11:02:11,159 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,230 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,230 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,231 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-14 11:02:11,231 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,231 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-14 11:02:11,231 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:11,231 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. started... 2023-02-14 11:02:11,231 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:11,231 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:11,231 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,232 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:11,231 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. started... 2023-02-14 11:02:11,232 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-14 11:02:11,233 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:11,232 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2b9b47d15cdb50b28b74e69ecd7b07e6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-14 11:02:11,233 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4043ad074064f04c99a556c4ccb426ba: 2023-02-14 11:02:11,231 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. started... 2023-02-14 11:02:11,233 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:11,233 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. started... 2023-02-14 11:02:11,234 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 4df9a62258c4abdc44dd57c5241dd480 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:11,233 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-14 11:02:11,235 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:02:11,233 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:11,233 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:02:11,235 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. started... 2023-02-14 11:02:11,235 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d7f71608b7ab02bc78e2a9ba466c6b90 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:11,234 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,236 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 38db420affeb6e2972189e2494e70bfd 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-14 11:02:11,233 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. started... 2023-02-14 11:02:11,236 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,237 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b2c08b25d72243932e8b9f08d12c111c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:11,237 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:02:11,237 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:02:11,277 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:11,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:02:11,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:11,279 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-14 11:02:11,284 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/.tmp/f1/9a3b190189dd4ea984c31e7e2e70b0ae 2023-02-14 11:02:11,304 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/.tmp/f1/a95b323f209c40ef904d4fe95bc7fbd4 2023-02-14 11:02:11,313 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/.tmp/f1/ef48c2d8aee74cbea8cade7b90abe9f4 2023-02-14 11:02:11,314 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/.tmp/f1/f4df1f177a00422dae13062bfb0959e8 2023-02-14 11:02:11,317 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. completed. 2023-02-14 11:02:11,317 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:11,317 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:11,317 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. started... 2023-02-14 11:02:11,317 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-14 11:02:11,324 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.HRegion(2744): Flushing face03591dcef4ef3d6e6d4b5fc0c429 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:11,336 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/.tmp/f1/1c492818116e48fba82dc2e30e75aefb 2023-02-14 11:02:11,364 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/.tmp/f2/7befb8fc36454f16bd0f4f8afc2910ef 2023-02-14 11:02:11,371 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/.tmp/f1/9a3b190189dd4ea984c31e7e2e70b0ae as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1/9a3b190189dd4ea984c31e7e2e70b0ae 2023-02-14 11:02:11,377 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1/9a3b190189dd4ea984c31e7e2e70b0ae, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,378 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/.tmp/f2/7befb8fc36454f16bd0f4f8afc2910ef as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2/7befb8fc36454f16bd0f4f8afc2910ef 2023-02-14 11:02:11,383 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2/7befb8fc36454f16bd0f4f8afc2910ef, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,385 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4df9a62258c4abdc44dd57c5241dd480 in 151ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:11,385 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-14 11:02:11,386 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4df9a62258c4abdc44dd57c5241dd480: 2023-02-14 11:02:11,386 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,386 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,386 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1/9a3b190189dd4ea984c31e7e2e70b0ae] hfiles 2023-02-14 11:02:11,386 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1/9a3b190189dd4ea984c31e7e2e70b0ae for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,386 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2/7befb8fc36454f16bd0f4f8afc2910ef] hfiles 2023-02-14 11:02:11,386 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2/7befb8fc36454f16bd0f4f8afc2910ef for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,398 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/.tmp/f2/bececfb1641b4b98854376284a461e27 2023-02-14 11:02:11,416 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/.tmp/f2/b5dc0041fb5a4a74b5ae4b2a85316922 2023-02-14 11:02:11,417 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/.tmp/f1/aeb51e32e20842bc8920f88e67f6c2d7 2023-02-14 11:02:11,421 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/.tmp/f1/ef48c2d8aee74cbea8cade7b90abe9f4 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1/ef48c2d8aee74cbea8cade7b90abe9f4 2023-02-14 11:02:11,428 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/.tmp/f2/11a0a7a0a7ae4eeb97096669dea51225 2023-02-14 11:02:11,431 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1/ef48c2d8aee74cbea8cade7b90abe9f4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,432 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/.tmp/f2/bececfb1641b4b98854376284a461e27 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2/bececfb1641b4b98854376284a461e27 2023-02-14 11:02:11,440 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/.tmp/f2/a013b05787174995971025c12178f3ef 2023-02-14 11:02:11,456 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/.tmp/f1/a95b323f209c40ef904d4fe95bc7fbd4 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1/a95b323f209c40ef904d4fe95bc7fbd4 2023-02-14 11:02:11,457 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2/bececfb1641b4b98854376284a461e27, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,458 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b2c08b25d72243932e8b9f08d12c111c in 221ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:11,458 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/.tmp/f1/f4df1f177a00422dae13062bfb0959e8 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1/f4df1f177a00422dae13062bfb0959e8 2023-02-14 11:02:11,460 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/.tmp/f1/1c492818116e48fba82dc2e30e75aefb as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1/1c492818116e48fba82dc2e30e75aefb 2023-02-14 11:02:11,464 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1/a95b323f209c40ef904d4fe95bc7fbd4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,465 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1/f4df1f177a00422dae13062bfb0959e8, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:02:11,466 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/.tmp/f2/11a0a7a0a7ae4eeb97096669dea51225 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2/11a0a7a0a7ae4eeb97096669dea51225 2023-02-14 11:02:11,466 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/.tmp/f2/b5dc0041fb5a4a74b5ae4b2a85316922 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2/b5dc0041fb5a4a74b5ae4b2a85316922 2023-02-14 11:02:11,467 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1/1c492818116e48fba82dc2e30e75aefb, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:02:11,468 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/.tmp/f2/a013b05787174995971025c12178f3ef as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2/a013b05787174995971025c12178f3ef 2023-02-14 11:02:11,469 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b2c08b25d72243932e8b9f08d12c111c: 2023-02-14 11:02:11,469 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. completed. 2023-02-14 11:02:11,469 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,469 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:11,469 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,469 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-14 11:02:11,469 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1/ef48c2d8aee74cbea8cade7b90abe9f4] hfiles 2023-02-14 11:02:11,469 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1/ef48c2d8aee74cbea8cade7b90abe9f4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,469 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:11,470 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2/bececfb1641b4b98854376284a461e27] hfiles 2023-02-14 11:02:11,470 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. started... 2023-02-14 11:02:11,470 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2/bececfb1641b4b98854376284a461e27 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,470 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a6edd594895698de5605457161632837 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:11,478 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2/11a0a7a0a7ae4eeb97096669dea51225, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:02:11,479 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 2b9b47d15cdb50b28b74e69ecd7b07e6 in 246ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:11,479 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2b9b47d15cdb50b28b74e69ecd7b07e6: 2023-02-14 11:02:11,479 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,479 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,479 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1/f4df1f177a00422dae13062bfb0959e8] hfiles 2023-02-14 11:02:11,479 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1/f4df1f177a00422dae13062bfb0959e8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,479 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2/11a0a7a0a7ae4eeb97096669dea51225] hfiles 2023-02-14 11:02:11,479 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2/11a0a7a0a7ae4eeb97096669dea51225 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,494 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2/b5dc0041fb5a4a74b5ae4b2a85316922, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,495 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d7f71608b7ab02bc78e2a9ba466c6b90 in 260ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:11,495 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d7f71608b7ab02bc78e2a9ba466c6b90: 2023-02-14 11:02:11,495 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,495 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,495 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1/a95b323f209c40ef904d4fe95bc7fbd4] hfiles 2023-02-14 11:02:11,495 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1/a95b323f209c40ef904d4fe95bc7fbd4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,495 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2/b5dc0041fb5a4a74b5ae4b2a85316922] hfiles 2023-02-14 11:02:11,495 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2/b5dc0041fb5a4a74b5ae4b2a85316922 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,500 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2/a013b05787174995971025c12178f3ef, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:02:11,500 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/.tmp/f2/49bd8b329b5440eab8bebf3e4b431077 2023-02-14 11:02:11,501 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 38db420affeb6e2972189e2494e70bfd in 265ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:11,501 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 38db420affeb6e2972189e2494e70bfd: 2023-02-14 11:02:11,501 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,502 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,502 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1/1c492818116e48fba82dc2e30e75aefb] hfiles 2023-02-14 11:02:11,502 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1/1c492818116e48fba82dc2e30e75aefb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,502 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2/a013b05787174995971025c12178f3ef] hfiles 2023-02-14 11:02:11,502 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2/a013b05787174995971025c12178f3ef for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,510 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. completed. 2023-02-14 11:02:11,510 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:11,510 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:11,510 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. started... 2023-02-14 11:02:11,510 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 00b4cdc10938611b392f2d51bf4c3a67 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:11,511 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-14 11:02:11,514 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/.tmp/f1/aeb51e32e20842bc8920f88e67f6c2d7 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1/aeb51e32e20842bc8920f88e67f6c2d7 2023-02-14 11:02:11,521 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/.tmp/f1/055666132e3745479a3cda8db59ed4c5 2023-02-14 11:02:11,525 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1/aeb51e32e20842bc8920f88e67f6c2d7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,526 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/.tmp/f2/49bd8b329b5440eab8bebf3e4b431077 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2/49bd8b329b5440eab8bebf3e4b431077 2023-02-14 11:02:11,528 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. completed. 2023-02-14 11:02:11,528 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:11,528 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-14 11:02:11,528 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. started... 2023-02-14 11:02:11,528 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3eed5453f8018cf240a595f4184b5b4c: 2023-02-14 11:02:11,528 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,529 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,529 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:02:11,529 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:02:11,532 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2/49bd8b329b5440eab8bebf3e4b431077, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,533 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for face03591dcef4ef3d6e6d4b5fc0c429 in 209ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:11,533 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for face03591dcef4ef3d6e6d4b5fc0c429: 2023-02-14 11:02:11,533 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,533 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,533 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1/aeb51e32e20842bc8920f88e67f6c2d7] hfiles 2023-02-14 11:02:11,533 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1/aeb51e32e20842bc8920f88e67f6c2d7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,533 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2/49bd8b329b5440eab8bebf3e4b431077] hfiles 2023-02-14 11:02:11,533 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2/49bd8b329b5440eab8bebf3e4b431077 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,540 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. completed. 2023-02-14 11:02:11,540 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:11,540 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-14 11:02:11,556 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. completed. 2023-02-14 11:02:11,556 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-14 11:02:11,564 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/.tmp/f1/04bd3095796b4fbc91a4234923cb02b5 2023-02-14 11:02:11,568 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. completed. 2023-02-14 11:02:11,568 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:11,568 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-14 11:02:11,579 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:11,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:02:11,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:11,582 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-14 11:02:11,591 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/.tmp/f2/6b9feccedec44e25827f570fa9e93d6f 2023-02-14 11:02:11,597 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/.tmp/f2/f20203f6558c4cdd90f66ed865fc57cc 2023-02-14 11:02:11,598 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/.tmp/f1/055666132e3745479a3cda8db59ed4c5 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1/055666132e3745479a3cda8db59ed4c5 2023-02-14 11:02:11,604 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/.tmp/f1/04bd3095796b4fbc91a4234923cb02b5 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1/04bd3095796b4fbc91a4234923cb02b5 2023-02-14 11:02:11,605 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1/055666132e3745479a3cda8db59ed4c5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,606 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/.tmp/f2/6b9feccedec44e25827f570fa9e93d6f as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2/6b9feccedec44e25827f570fa9e93d6f 2023-02-14 11:02:11,609 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1/04bd3095796b4fbc91a4234923cb02b5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,610 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/.tmp/f2/f20203f6558c4cdd90f66ed865fc57cc as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2/f20203f6558c4cdd90f66ed865fc57cc 2023-02-14 11:02:11,612 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2/6b9feccedec44e25827f570fa9e93d6f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,613 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a6edd594895698de5605457161632837 in 143ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:11,614 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a6edd594895698de5605457161632837: 2023-02-14 11:02:11,614 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,614 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,614 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1/055666132e3745479a3cda8db59ed4c5] hfiles 2023-02-14 11:02:11,614 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1/055666132e3745479a3cda8db59ed4c5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,614 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2/6b9feccedec44e25827f570fa9e93d6f] hfiles 2023-02-14 11:02:11,614 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2/6b9feccedec44e25827f570fa9e93d6f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,616 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2/f20203f6558c4cdd90f66ed865fc57cc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:11,617 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 00b4cdc10938611b392f2d51bf4c3a67 in 106ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:11,617 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 00b4cdc10938611b392f2d51bf4c3a67: 2023-02-14 11:02:11,617 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,617 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:11,617 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1/04bd3095796b4fbc91a4234923cb02b5] hfiles 2023-02-14 11:02:11,617 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1/04bd3095796b4fbc91a4234923cb02b5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,617 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2/f20203f6558c4cdd90f66ed865fc57cc] hfiles 2023-02-14 11:02:11,617 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2/f20203f6558c4cdd90f66ed865fc57cc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,628 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. completed. 2023-02-14 11:02:11,628 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:11,628 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-14 11:02:11,632 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. completed. 2023-02-14 11:02:11,632 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:11,632 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-14 11:02:11,632 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-14 11:02:11,632 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,632 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-14 11:02:11,632 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,36277,1676372527623' in zk 2023-02-14 11:02:11,634 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-14 11:02:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:11,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-14 11:02:11,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,36277,1676372527623': 2023-02-14 11:02:11,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36277,1676372527623' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-14 11:02:11,990 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. completed. 2023-02-14 11:02:11,990 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:11,990 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-14 11:02:11,990 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-14 11:02:11,990 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,990 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-14 11:02:11,990 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,46753,1676372527678' in zk 2023-02-14 11:02:11,992 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-14 11:02:11,992 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,992 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:11,992 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-14 11:02:11,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:11,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:11,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:11,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:11,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,46753,1676372527678': 2023-02-14 11:02:11,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46753,1676372527678' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-14 11:02:11,996 INFO [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-14 11:02:11,996 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:11,996 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:11,996 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,996 INFO [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-14 11:02:11,998 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,998 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:11,998 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:11,998 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,998 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:11,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:11,999 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:11,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,999 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:11,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:12,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:12,001 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:12,001 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:12,012 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:12,012 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:12,012 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:12,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:12,012 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:12,012 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:12,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:12,012 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:12,012 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:12,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,013 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,013 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,013 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:12,013 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,013 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,013 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,014 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:12,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:12,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-14 11:02:12,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,078 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:12,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676372530973Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676372532013 (+1040 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676372532013Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676372532028 (+15 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676372532040 (+12 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676372532077 (+37 ms) 2023-02-14 11:02:12,080 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-14 11:02:12,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1060 sec 2023-02-14 11:02:12,082 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:12,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:02:12,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-14 11:02:12,084 INFO [Listener at localhost/41749] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-14 11:02:12,088 INFO [Listener at localhost/41749] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-14 11:02:12,095 INFO [Listener at localhost/41749] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-14 11:02:12,127 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46753] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:12,137 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36277] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:12,216 INFO [Listener at localhost/41749] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-14 11:02:12,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-14 11:02:12,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-14 11:02:12,227 INFO [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-14 11:02:12,227 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:12,228 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-14 11:02:12,228 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-14 11:02:12,228 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:12,228 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:12,230 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:12,230 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,230 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:12,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:12,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:12,230 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,230 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:12,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:12,231 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:12,231 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:12,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:12,231 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-14 11:02:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:12,231 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-14 11:02:12,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-14 11:02:12,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-14 11:02:12,236 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-14 11:02:12,236 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:12,236 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-14 11:02:12,237 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-14 11:02:12,237 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:12,237 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:12,237 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-14 11:02:12,237 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. started... 2023-02-14 11:02:12,237 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4043ad074064f04c99a556c4ccb426ba: 2023-02-14 11:02:12,238 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:12,238 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:12,238 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. started... 2023-02-14 11:02:12,238 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:12,238 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. started... 2023-02-14 11:02:12,238 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 38db420affeb6e2972189e2494e70bfd 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-14 11:02:12,238 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b9b47d15cdb50b28b74e69ecd7b07e6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-14 11:02:12,463 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:12,464 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. started... 2023-02-14 11:02:12,464 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:12,467 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. started... 2023-02-14 11:02:12,467 INFO [AsyncFSWAL-0-hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce-prefix:jenkins-hbase4.apache.org,46753,1676372527678] wal.AbstractFSWAL(1045): Slow sync cost: 228 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK], DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK]] 2023-02-14 11:02:12,463 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-14 11:02:12,469 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:12,467 INFO [AsyncFSWAL-0-hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce-prefix:jenkins-hbase4.apache.org,36277,1676372527623] wal.AbstractFSWAL(1045): Slow sync cost: 228 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:40255,DS-6878460e-9cdf-4bac-b440-0559ab0cffeb,DISK], DatanodeInfoWithStorage[127.0.0.1:40777,DS-b3680d55-857c-4e87-b610-71814fd1c831,DISK]] 2023-02-14 11:02:12,467 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d7f71608b7ab02bc78e2a9ba466c6b90 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:12,467 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4df9a62258c4abdc44dd57c5241dd480 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:12,466 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:12,466 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:12,470 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. started... 2023-02-14 11:02:12,470 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b2c08b25d72243932e8b9f08d12c111c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:12,465 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-14 11:02:12,470 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:12,470 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-14 11:02:12,470 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. started... 2023-02-14 11:02:12,470 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing face03591dcef4ef3d6e6d4b5fc0c429 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:12,525 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/.tmp/f1/21f2d44bf1224bfea405b130bb6c79aa 2023-02-14 11:02:12,526 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/.tmp/f1/8a5306ee670a4244ba94dcd6f418ed9e 2023-02-14 11:02:12,528 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/.tmp/f1/4098bacb761048668d85b6e2d463ad84 2023-02-14 11:02:12,531 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/.tmp/f1/f3013b5dea4b4740a6bf8206a6bcf797 2023-02-14 11:02:12,546 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/.tmp/f1/aa980d506a2f430bb82fe87d5451cd54 2023-02-14 11:02:12,563 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/.tmp/f1/56744611f5d745a29f5f0d307a32c1f3 2023-02-14 11:02:12,592 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/.tmp/f2/054a37af313c4eb1aac5ec5e158efae3 2023-02-14 11:02:12,598 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/.tmp/f1/8a5306ee670a4244ba94dcd6f418ed9e as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1/8a5306ee670a4244ba94dcd6f418ed9e 2023-02-14 11:02:12,600 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/.tmp/f2/eb1108ace44c4112b55fb14c3cdb57c1 2023-02-14 11:02:12,604 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1/8a5306ee670a4244ba94dcd6f418ed9e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:12,605 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/.tmp/f2/054a37af313c4eb1aac5ec5e158efae3 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2/054a37af313c4eb1aac5ec5e158efae3 2023-02-14 11:02:12,606 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/.tmp/f1/21f2d44bf1224bfea405b130bb6c79aa as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1/21f2d44bf1224bfea405b130bb6c79aa 2023-02-14 11:02:12,610 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2/054a37af313c4eb1aac5ec5e158efae3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:12,611 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 2b9b47d15cdb50b28b74e69ecd7b07e6 in 373ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:12,611 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b9b47d15cdb50b28b74e69ecd7b07e6: 2023-02-14 11:02:12,611 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:12,612 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1/21f2d44bf1224bfea405b130bb6c79aa, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,612 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-14 11:02:12,612 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:12,612 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. started... 2023-02-14 11:02:12,612 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a6edd594895698de5605457161632837 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:12,613 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/.tmp/f2/eb1108ace44c4112b55fb14c3cdb57c1 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2/eb1108ace44c4112b55fb14c3cdb57c1 2023-02-14 11:02:12,619 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2/eb1108ace44c4112b55fb14c3cdb57c1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,619 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d7f71608b7ab02bc78e2a9ba466c6b90 in 152ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:12,620 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d7f71608b7ab02bc78e2a9ba466c6b90: 2023-02-14 11:02:12,620 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:12,620 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:12,620 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-14 11:02:12,620 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. started... 2023-02-14 11:02:12,620 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 00b4cdc10938611b392f2d51bf4c3a67 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:12,628 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/.tmp/f2/4e3c6ad698ba4b5a98cc8afda8a13419 2023-02-14 11:02:12,638 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/.tmp/f1/aa980d506a2f430bb82fe87d5451cd54 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1/aa980d506a2f430bb82fe87d5451cd54 2023-02-14 11:02:12,644 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/.tmp/f2/1c31fd46e30842b6a2dd39baa9f4a092 2023-02-14 11:02:12,644 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/.tmp/f2/c5ff8997bdba46fd936277898659c3ae 2023-02-14 11:02:12,647 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1/aa980d506a2f430bb82fe87d5451cd54, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,648 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/.tmp/f2/4e3c6ad698ba4b5a98cc8afda8a13419 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2/4e3c6ad698ba4b5a98cc8afda8a13419 2023-02-14 11:02:12,654 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/.tmp/f1/f3013b5dea4b4740a6bf8206a6bcf797 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1/f3013b5dea4b4740a6bf8206a6bcf797 2023-02-14 11:02:12,654 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/.tmp/f1/56744611f5d745a29f5f0d307a32c1f3 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1/56744611f5d745a29f5f0d307a32c1f3 2023-02-14 11:02:12,659 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2/4e3c6ad698ba4b5a98cc8afda8a13419, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,661 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4df9a62258c4abdc44dd57c5241dd480 in 194ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:12,661 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4df9a62258c4abdc44dd57c5241dd480: 2023-02-14 11:02:12,661 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:12,661 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-14 11:02:12,662 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1/f3013b5dea4b4740a6bf8206a6bcf797, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:12,663 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/.tmp/f2/1c31fd46e30842b6a2dd39baa9f4a092 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2/1c31fd46e30842b6a2dd39baa9f4a092 2023-02-14 11:02:12,668 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2/1c31fd46e30842b6a2dd39baa9f4a092, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:12,669 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 38db420affeb6e2972189e2494e70bfd in 431ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:12,669 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 38db420affeb6e2972189e2494e70bfd: 2023-02-14 11:02:12,669 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:12,672 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/.tmp/f1/807bd794839d4b338980e54d73f17527 2023-02-14 11:02:12,676 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:12,676 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-14 11:02:12,676 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. started... 2023-02-14 11:02:12,676 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3eed5453f8018cf240a595f4184b5b4c: 2023-02-14 11:02:12,676 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:12,676 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-14 11:02:12,681 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1/56744611f5d745a29f5f0d307a32c1f3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,682 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/.tmp/f2/c5ff8997bdba46fd936277898659c3ae as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2/c5ff8997bdba46fd936277898659c3ae 2023-02-14 11:02:12,688 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2/c5ff8997bdba46fd936277898659c3ae, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,689 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/.tmp/f1/ec6bcd9632c4438d8ac3fc90244ec129 2023-02-14 11:02:12,689 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b2c08b25d72243932e8b9f08d12c111c in 219ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:12,689 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b2c08b25d72243932e8b9f08d12c111c: 2023-02-14 11:02:12,689 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:12,690 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-14 11:02:12,708 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/.tmp/f2/0616b5a522fa449fb258e02747e80570 2023-02-14 11:02:12,709 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/.tmp/f2/33f363413b724805a9d80fcab3ceb26c 2023-02-14 11:02:12,715 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/.tmp/f1/807bd794839d4b338980e54d73f17527 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1/807bd794839d4b338980e54d73f17527 2023-02-14 11:02:12,715 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/.tmp/f1/ec6bcd9632c4438d8ac3fc90244ec129 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1/ec6bcd9632c4438d8ac3fc90244ec129 2023-02-14 11:02:12,722 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1/807bd794839d4b338980e54d73f17527, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,722 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1/ec6bcd9632c4438d8ac3fc90244ec129, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,723 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/.tmp/f2/33f363413b724805a9d80fcab3ceb26c as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2/33f363413b724805a9d80fcab3ceb26c 2023-02-14 11:02:12,723 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/.tmp/f2/0616b5a522fa449fb258e02747e80570 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2/0616b5a522fa449fb258e02747e80570 2023-02-14 11:02:12,729 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2/33f363413b724805a9d80fcab3ceb26c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,730 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 00b4cdc10938611b392f2d51bf4c3a67 in 110ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:12,731 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 00b4cdc10938611b392f2d51bf4c3a67: 2023-02-14 11:02:12,731 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-14 11:02:12,732 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2/0616b5a522fa449fb258e02747e80570, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,733 INFO [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a6edd594895698de5605457161632837 in 121ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:12,733 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a6edd594895698de5605457161632837: 2023-02-14 11:02:12,733 DEBUG [rs(jenkins-hbase4.apache.org,36277,1676372527623)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:12,733 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-14 11:02:12,733 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-14 11:02:12,733 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,733 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-14 11:02:12,733 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36277,1676372527623' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-14 11:02:12,735 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:12,735 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:12,735 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:12,735 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:12,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36277,1676372527623' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-14 11:02:12,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10abeb30[Count = 1] remaining members to acquire global barrier 2023-02-14 11:02:12,983 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/.tmp/f2/717145789993412884b144db56dc17f7 2023-02-14 11:02:12,989 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/.tmp/f1/4098bacb761048668d85b6e2d463ad84 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1/4098bacb761048668d85b6e2d463ad84 2023-02-14 11:02:12,994 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1/4098bacb761048668d85b6e2d463ad84, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,994 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/.tmp/f2/717145789993412884b144db56dc17f7 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2/717145789993412884b144db56dc17f7 2023-02-14 11:02:12,998 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2/717145789993412884b144db56dc17f7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:12,999 INFO [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for face03591dcef4ef3d6e6d4b5fc0c429 in 529ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:12,999 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for face03591dcef4ef3d6e6d4b5fc0c429: 2023-02-14 11:02:12,999 DEBUG [rs(jenkins-hbase4.apache.org,46753,1676372527678)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:12,999 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-14 11:02:12,999 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-14 11:02:12,999 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:12,999 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-14 11:02:12,999 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46753,1676372527678' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-14 11:02:13,002 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,002 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:13,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:13,002 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,002 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:13,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:13,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:13,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:13,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:13,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46753,1676372527678' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-14 11:02:13,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10abeb30[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:13,004 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-14 11:02:13,004 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,005 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,005 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,005 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-14 11:02:13,005 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,005 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-14 11:02:13,005 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-14 11:02:13,005 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46753,1676372527678' in zk 2023-02-14 11:02:13,005 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-14 11:02:13,005 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36277,1676372527623' in zk 2023-02-14 11:02:13,005 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,006 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-14 11:02:13,007 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:13,007 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,007 DEBUG [member: 'jenkins-hbase4.apache.org,46753,1676372527678' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-14 11:02:13,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:13,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:13,008 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,008 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-14 11:02:13,008 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:13,008 DEBUG [member: 'jenkins-hbase4.apache.org,36277,1676372527623' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-14 11:02:13,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:13,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:13,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:13,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:13,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:13,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46753,1676372527678': 2023-02-14 11:02:13,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46753,1676372527678' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-14 11:02:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,36277,1676372527623': 2023-02-14 11:02:13,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36277,1676372527623' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-14 11:02:13,014 INFO [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-14 11:02:13,014 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:13,014 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:13,014 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-14 11:02:13,014 INFO [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-14 11:02:13,016 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,016 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,016 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:13,016 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,017 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:13,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,017 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:13,017 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,020 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,020 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:13,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:13,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,023 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,023 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:13,023 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:13,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:13,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:13,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:13,023 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:13,023 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:13,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-14 11:02:13,023 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:13,023 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-14 11:02:13,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-14 11:02:13,023 DEBUG [(jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:13,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:13,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:13,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:13,023 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:13,025 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,025 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,025 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,025 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:13,025 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:13,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:13,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:13,025 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:13,025 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-14 11:02:13,125 DEBUG [Listener at localhost/41749] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-14 11:02:13,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40109] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-14 11:02:13,127 INFO [Listener at localhost/41749] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-14 11:02:13,128 DEBUG [Listener at localhost/41749] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ecc4d24 to 127.0.0.1:54770 2023-02-14 11:02:13,128 DEBUG [Listener at localhost/41749] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:13,128 DEBUG [Listener at localhost/41749] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-14 11:02:13,128 DEBUG [Listener at localhost/41749] util.JVMClusterUtil(257): Found active master hash=2048932081, stopped=false 2023-02-14 11:02:13,128 INFO [Listener at localhost/41749] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:13,130 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:13,130 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:13,130 INFO [Listener at localhost/41749] procedure2.ProcedureExecutor(629): Stopping 2023-02-14 11:02:13,130 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:13,130 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:13,132 DEBUG [Listener at localhost/41749] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02c9b2b8 to 127.0.0.1:54770 2023-02-14 11:02:13,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:13,133 DEBUG [Listener at localhost/41749] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:13,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:13,133 INFO [Listener at localhost/41749] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36277,1676372527623' ***** 2023-02-14 11:02:13,133 INFO [Listener at localhost/41749] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:13,133 INFO [Listener at localhost/41749] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46753,1676372527678' ***** 2023-02-14 11:02:13,133 INFO [Listener at localhost/41749] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:13,133 INFO [RS:0;jenkins-hbase4:36277] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:13,133 INFO [RS:1;jenkins-hbase4:46753] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:13,133 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:13,133 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:13,133 INFO [RS:1;jenkins-hbase4:46753] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:13,133 INFO [RS:0;jenkins-hbase4:36277] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:13,135 INFO [RS:1;jenkins-hbase4:46753] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:13,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:13,135 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(3304): Received CLOSE for 94b54c92417b13a60dac4e1954a416d0 2023-02-14 11:02:13,135 INFO [RS:0;jenkins-hbase4:36277] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:13,135 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(3304): Received CLOSE for 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:13,135 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(3304): Received CLOSE for 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:13,135 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(3304): Received CLOSE for 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:13,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 94b54c92417b13a60dac4e1954a416d0, disabling compactions & flushes 2023-02-14 11:02:13,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2b9b47d15cdb50b28b74e69ecd7b07e6, disabling compactions & flushes 2023-02-14 11:02:13,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:13,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:13,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:13,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:13,135 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(3304): Received CLOSE for d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:13,135 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(3304): Received CLOSE for 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:13,136 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(3304): Received CLOSE for a6edd594895698de5605457161632837 2023-02-14 11:02:13,136 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(3304): Received CLOSE for b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:13,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. after waiting 0 ms 2023-02-14 11:02:13,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. after waiting 0 ms 2023-02-14 11:02:13,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:13,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:13,136 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(3304): Received CLOSE for face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:13,136 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(3304): Received CLOSE for 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:13,136 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(3304): Received CLOSE for 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:13,136 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 94b54c92417b13a60dac4e1954a416d0 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-14 11:02:13,136 DEBUG [RS:0;jenkins-hbase4:36277] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39d379e0 to 127.0.0.1:54770 2023-02-14 11:02:13,136 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,136 DEBUG [RS:0;jenkins-hbase4:36277] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:13,136 DEBUG [RS:1;jenkins-hbase4:46753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13ad1457 to 127.0.0.1:54770 2023-02-14 11:02:13,136 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-14 11:02:13,136 DEBUG [RS:1;jenkins-hbase4:46753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:13,136 INFO [RS:1;jenkins-hbase4:46753] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:13,137 INFO [RS:1;jenkins-hbase4:46753] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:13,137 INFO [RS:1;jenkins-hbase4:46753] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:13,138 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-14 11:02:13,136 DEBUG [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1479): Online Regions={2b9b47d15cdb50b28b74e69ecd7b07e6=testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6., 4df9a62258c4abdc44dd57c5241dd480=testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480., d7f71608b7ab02bc78e2a9ba466c6b90=testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90., a6edd594895698de5605457161632837=testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837., 00b4cdc10938611b392f2d51bf4c3a67=testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.} 2023-02-14 11:02:13,139 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-14 11:02:13,139 DEBUG [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1479): Online Regions={94b54c92417b13a60dac4e1954a416d0=hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0., 4043ad074064f04c99a556c4ccb426ba=testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba., 1588230740=hbase:meta,,1.1588230740, 38db420affeb6e2972189e2494e70bfd=testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd., b2c08b25d72243932e8b9f08d12c111c=testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c., face03591dcef4ef3d6e6d4b5fc0c429=testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429., 3eed5453f8018cf240a595f4184b5b4c=testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.} 2023-02-14 11:02:13,139 DEBUG [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1505): Waiting on 00b4cdc10938611b392f2d51bf4c3a67, 2b9b47d15cdb50b28b74e69ecd7b07e6, 4df9a62258c4abdc44dd57c5241dd480, a6edd594895698de5605457161632837, d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:13,140 DEBUG [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1505): Waiting on 1588230740, 38db420affeb6e2972189e2494e70bfd, 3eed5453f8018cf240a595f4184b5b4c, 4043ad074064f04c99a556c4ccb426ba, 94b54c92417b13a60dac4e1954a416d0, b2c08b25d72243932e8b9f08d12c111c, face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:13,140 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:13,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:13,140 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:13,140 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:13,140 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:13,141 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-14 11:02:13,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:13,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:13,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2b9b47d15cdb50b28b74e69ecd7b07e6: 2023-02-14 11:02:13,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:13,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4df9a62258c4abdc44dd57c5241dd480, disabling compactions & flushes 2023-02-14 11:02:13,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:13,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:13,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. after waiting 0 ms 2023-02-14 11:02:13,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:13,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0/.tmp/info/e5f4874a31c64d9399942d1af5ad8040 2023-02-14 11:02:13,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/.tmp/info/b23161f0416245f484e023424e2f90fd 2023-02-14 11:02:13,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:13,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:13,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4df9a62258c4abdc44dd57c5241dd480: 2023-02-14 11:02:13,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:13,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d7f71608b7ab02bc78e2a9ba466c6b90, disabling compactions & flushes 2023-02-14 11:02:13,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:13,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:13,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. after waiting 0 ms 2023-02-14 11:02:13,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:13,164 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:13,164 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:13,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0/.tmp/info/e5f4874a31c64d9399942d1af5ad8040 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0/info/e5f4874a31c64d9399942d1af5ad8040 2023-02-14 11:02:13,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:13,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:13,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d7f71608b7ab02bc78e2a9ba466c6b90: 2023-02-14 11:02:13,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:13,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a6edd594895698de5605457161632837, disabling compactions & flushes 2023-02-14 11:02:13,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:13,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:13,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. after waiting 0 ms 2023-02-14 11:02:13,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:13,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0/info/e5f4874a31c64d9399942d1af5ad8040, entries=2, sequenceid=6, filesize=4.8 K 2023-02-14 11:02:13,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 94b54c92417b13a60dac4e1954a416d0 in 46ms, sequenceid=6, compaction requested=false 2023-02-14 11:02:13,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-14 11:02:13,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/a6edd594895698de5605457161632837/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:13,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:13,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a6edd594895698de5605457161632837: 2023-02-14 11:02:13,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:13,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 00b4cdc10938611b392f2d51bf4c3a67, disabling compactions & flushes 2023-02-14 11:02:13,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:13,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:13,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. after waiting 0 ms 2023-02-14 11:02:13,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:13,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/namespace/94b54c92417b13a60dac4e1954a416d0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-14 11:02:13,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:13,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 94b54c92417b13a60dac4e1954a416d0: 2023-02-14 11:02:13,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676372528430.94b54c92417b13a60dac4e1954a416d0. 2023-02-14 11:02:13,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4043ad074064f04c99a556c4ccb426ba, disabling compactions & flushes 2023-02-14 11:02:13,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:13,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:13,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. after waiting 0 ms 2023-02-14 11:02:13,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:13,201 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-14 11:02:13,201 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-14 11:02:13,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/.tmp/table/2551dec6cf4245c1bed00ae57317cf8e 2023-02-14 11:02:13,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-14 11:02:13,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:13,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:13,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4043ad074064f04c99a556c4ccb426ba: 2023-02-14 11:02:13,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:13,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 00b4cdc10938611b392f2d51bf4c3a67: 2023-02-14 11:02:13,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:13,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:13,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 38db420affeb6e2972189e2494e70bfd, disabling compactions & flushes 2023-02-14 11:02:13,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:13,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:13,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. after waiting 0 ms 2023-02-14 11:02:13,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:13,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:13,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:13,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 38db420affeb6e2972189e2494e70bfd: 2023-02-14 11:02:13,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:13,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b2c08b25d72243932e8b9f08d12c111c, disabling compactions & flushes 2023-02-14 11:02:13,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:13,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:13,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. after waiting 0 ms 2023-02-14 11:02:13,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:13,218 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/.tmp/info/b23161f0416245f484e023424e2f90fd as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/info/b23161f0416245f484e023424e2f90fd 2023-02-14 11:02:13,224 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/info/b23161f0416245f484e023424e2f90fd, entries=110, sequenceid=32, filesize=18.7 K 2023-02-14 11:02:13,225 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/.tmp/table/2551dec6cf4245c1bed00ae57317cf8e as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/table/2551dec6cf4245c1bed00ae57317cf8e 2023-02-14 11:02:13,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:13,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:13,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b2c08b25d72243932e8b9f08d12c111c: 2023-02-14 11:02:13,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:13,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing face03591dcef4ef3d6e6d4b5fc0c429, disabling compactions & flushes 2023-02-14 11:02:13,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:13,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:13,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. after waiting 0 ms 2023-02-14 11:02:13,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:13,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/table/2551dec6cf4245c1bed00ae57317cf8e, entries=4, sequenceid=32, filesize=4.8 K 2023-02-14 11:02:13,232 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 91ms, sequenceid=32, compaction requested=false 2023-02-14 11:02:13,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-14 11:02:13,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:13,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:13,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for face03591dcef4ef3d6e6d4b5fc0c429: 2023-02-14 11:02:13,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:13,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3eed5453f8018cf240a595f4184b5b4c, disabling compactions & flushes 2023-02-14 11:02:13,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:13,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:13,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. after waiting 0 ms 2023-02-14 11:02:13,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:13,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-14 11:02:13,241 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-14 11:02:13,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:13,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3eed5453f8018cf240a595f4184b5b4c: 2023-02-14 11:02:13,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:13,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:13,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:13,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:13,244 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:13,340 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36277,1676372527623; all regions closed. 2023-02-14 11:02:13,340 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46753,1676372527678; all regions closed. 2023-02-14 11:02:13,345 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/WALs/jenkins-hbase4.apache.org,46753,1676372527678/jenkins-hbase4.apache.org%2C46753%2C1676372527678.meta.1676372528326.meta not finished, retry = 0 2023-02-14 11:02:13,346 DEBUG [RS:0;jenkins-hbase4:36277] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/oldWALs 2023-02-14 11:02:13,347 INFO [RS:0;jenkins-hbase4:36277] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36277%2C1676372527623:(num 1676372529183) 2023-02-14 11:02:13,347 DEBUG [RS:0;jenkins-hbase4:36277] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:13,347 INFO [RS:0;jenkins-hbase4:36277] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:13,347 INFO [RS:0;jenkins-hbase4:36277] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:13,347 INFO [RS:0;jenkins-hbase4:36277] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:13,347 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:13,347 INFO [RS:0;jenkins-hbase4:36277] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:13,347 INFO [RS:0;jenkins-hbase4:36277] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:13,348 INFO [RS:0;jenkins-hbase4:36277] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36277 2023-02-14 11:02:13,350 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,350 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:13,351 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:13,351 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36277,1676372527623 2023-02-14 11:02:13,351 ERROR [Listener at localhost/41749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b1875e6 rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:13,351 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:13,353 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36277,1676372527623] 2023-02-14 11:02:13,353 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36277,1676372527623; numProcessing=1 2023-02-14 11:02:13,354 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36277,1676372527623 already deleted, retry=false 2023-02-14 11:02:13,354 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36277,1676372527623 expired; onlineServers=1 2023-02-14 11:02:13,447 DEBUG [RS:1;jenkins-hbase4:46753] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/oldWALs 2023-02-14 11:02:13,448 INFO [RS:1;jenkins-hbase4:46753] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46753%2C1676372527678.meta:.meta(num 1676372528326) 2023-02-14 11:02:13,453 DEBUG [RS:1;jenkins-hbase4:46753] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/oldWALs 2023-02-14 11:02:13,453 INFO [RS:1;jenkins-hbase4:46753] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46753%2C1676372527678:(num 1676372528835) 2023-02-14 11:02:13,453 DEBUG [RS:1;jenkins-hbase4:46753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:13,453 INFO [RS:1;jenkins-hbase4:46753] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:13,453 INFO [RS:1;jenkins-hbase4:46753] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:13,454 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:13,454 INFO [RS:1;jenkins-hbase4:46753] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46753 2023-02-14 11:02:13,456 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:13,456 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46753,1676372527678 2023-02-14 11:02:13,456 ERROR [Listener at localhost/41749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30b82205 rejected from java.util.concurrent.ThreadPoolExecutor@3487b0ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:13,457 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46753,1676372527678] 2023-02-14 11:02:13,457 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46753,1676372527678; numProcessing=2 2023-02-14 11:02:13,459 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46753,1676372527678 already deleted, retry=false 2023-02-14 11:02:13,459 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46753,1676372527678 expired; onlineServers=0 2023-02-14 11:02:13,459 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40109,1676372527540' ***** 2023-02-14 11:02:13,459 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-14 11:02:13,460 DEBUG [M:0;jenkins-hbase4:40109] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b1d32ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:13,460 INFO [M:0;jenkins-hbase4:40109] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40109,1676372527540 2023-02-14 11:02:13,461 INFO [M:0;jenkins-hbase4:40109] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40109,1676372527540; all regions closed. 2023-02-14 11:02:13,461 DEBUG [M:0;jenkins-hbase4:40109] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:13,461 DEBUG [M:0;jenkins-hbase4:40109] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-14 11:02:13,461 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-14 11:02:13,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372527937] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372527937,5,FailOnTimeoutGroup] 2023-02-14 11:02:13,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372527937] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372527937,5,FailOnTimeoutGroup] 2023-02-14 11:02:13,461 DEBUG [M:0;jenkins-hbase4:40109] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-14 11:02:13,462 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:13,462 INFO [M:0;jenkins-hbase4:40109] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-14 11:02:13,462 INFO [M:0;jenkins-hbase4:40109] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-14 11:02:13,462 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:13,462 INFO [M:0;jenkins-hbase4:40109] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-14 11:02:13,462 DEBUG [M:0;jenkins-hbase4:40109] master.HMaster(1512): Stopping service threads 2023-02-14 11:02:13,462 INFO [M:0;jenkins-hbase4:40109] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-14 11:02:13,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:13,463 ERROR [M:0;jenkins-hbase4:40109] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-14 11:02:13,463 INFO [M:0;jenkins-hbase4:40109] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-14 11:02:13,463 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-14 11:02:13,464 DEBUG [M:0;jenkins-hbase4:40109] zookeeper.ZKUtil(398): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-14 11:02:13,464 WARN [M:0;jenkins-hbase4:40109] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-14 11:02:13,464 INFO [M:0;jenkins-hbase4:40109] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-14 11:02:13,464 INFO [M:0;jenkins-hbase4:40109] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-14 11:02:13,464 DEBUG [M:0;jenkins-hbase4:40109] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:13,464 INFO [M:0;jenkins-hbase4:40109] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:13,464 DEBUG [M:0;jenkins-hbase4:40109] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:13,464 DEBUG [M:0;jenkins-hbase4:40109] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:13,464 DEBUG [M:0;jenkins-hbase4:40109] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:13,464 INFO [M:0;jenkins-hbase4:40109] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-14 11:02:13,475 INFO [M:0;jenkins-hbase4:40109] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ba387fc60ac547babbc67f9067c0e935 2023-02-14 11:02:13,481 DEBUG [M:0;jenkins-hbase4:40109] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ba387fc60ac547babbc67f9067c0e935 as hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ba387fc60ac547babbc67f9067c0e935 2023-02-14 11:02:13,486 INFO [M:0;jenkins-hbase4:40109] regionserver.HStore(1080): Added hdfs://localhost:32885/user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ba387fc60ac547babbc67f9067c0e935, entries=31, sequenceid=218, filesize=9.0 K 2023-02-14 11:02:13,487 INFO [M:0;jenkins-hbase4:40109] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=218, compaction requested=false 2023-02-14 11:02:13,488 INFO [M:0;jenkins-hbase4:40109] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:13,488 DEBUG [M:0;jenkins-hbase4:40109] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:13,492 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f2041651-306c-9fa4-a93b-26fe9e6160ce/MasterData/WALs/jenkins-hbase4.apache.org,40109,1676372527540/jenkins-hbase4.apache.org%2C40109%2C1676372527540.1676372527811 not finished, retry = 0 2023-02-14 11:02:13,593 INFO [M:0;jenkins-hbase4:40109] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-14 11:02:13,593 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:13,594 INFO [M:0;jenkins-hbase4:40109] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40109 2023-02-14 11:02:13,597 DEBUG [M:0;jenkins-hbase4:40109] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40109,1676372527540 already deleted, retry=false 2023-02-14 11:02:13,632 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:13,632 INFO [RS:1;jenkins-hbase4:46753] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46753,1676372527678; zookeeper connection closed. 2023-02-14 11:02:13,632 ERROR [Listener at localhost/41749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31e79fbf rejected from java.util.concurrent.ThreadPoolExecutor@3487b0ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:13,632 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@763086de] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@763086de 2023-02-14 11:02:13,632 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:46753-0x100527eb3560002, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:13,633 ERROR [Listener at localhost/41749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@49b6d2a1 rejected from java.util.concurrent.ThreadPoolExecutor@3487b0ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:13,732 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:13,732 INFO [RS:0;jenkins-hbase4:36277] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36277,1676372527623; zookeeper connection closed. 2023-02-14 11:02:13,732 ERROR [Listener at localhost/41749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@335a1355 rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:13,733 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@15415118] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@15415118 2023-02-14 11:02:13,733 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): regionserver:36277-0x100527eb3560001, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:13,733 ERROR [Listener at localhost/41749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b20d5bc rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:13,733 INFO [Listener at localhost/41749] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-14 11:02:13,832 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:13,832 INFO [M:0;jenkins-hbase4:40109] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40109,1676372527540; zookeeper connection closed. 2023-02-14 11:02:13,833 ERROR [Listener at localhost/41749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45098587 rejected from java.util.concurrent.ThreadPoolExecutor@413619fe[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:13,833 DEBUG [Listener at localhost/41749-EventThread] zookeeper.ZKWatcher(600): master:40109-0x100527eb3560000, quorum=127.0.0.1:54770, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:13,833 ERROR [Listener at localhost/41749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c56c7b6 rejected from java.util.concurrent.ThreadPoolExecutor@413619fe[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:13,919 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop-6499862346674885679.jar 2023-02-14 11:02:13,924 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676372530913 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:13,924 DEBUG [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce 2023-02-14 11:02:13,924 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:13,924 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:13,924 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: a6edd594895698de5605457161632837 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(239): region to add: face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=4043ad074064f04c99a556c4ccb426ba as 4043ad074064f04c99a556c4ccb426ba in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=2b9b47d15cdb50b28b74e69ecd7b07e6 as 2b9b47d15cdb50b28b74e69ecd7b07e6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=4df9a62258c4abdc44dd57c5241dd480 as 4df9a62258c4abdc44dd57c5241dd480 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=d7f71608b7ab02bc78e2a9ba466c6b90 as d7f71608b7ab02bc78e2a9ba466c6b90 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=38db420affeb6e2972189e2494e70bfd as 38db420affeb6e2972189e2494e70bfd in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=a6edd594895698de5605457161632837 as a6edd594895698de5605457161632837 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=00b4cdc10938611b392f2d51bf4c3a67 as 00b4cdc10938611b392f2d51bf4c3a67 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=b2c08b25d72243932e8b9f08d12c111c as b2c08b25d72243932e8b9f08d12c111c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=3eed5453f8018cf240a595f4184b5b4c as 3eed5453f8018cf240a595f4184b5b4c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,925 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(585): clone region=face03591dcef4ef3d6e6d4b5fc0c429 as face03591dcef4ef3d6e6d4b5fc0c429 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-14 11:02:13,926 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 38db420affeb6e2972189e2494e70bfd, NAME => 'testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,927 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => a6edd594895698de5605457161632837, NAME => 'testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,928 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 00b4cdc10938611b392f2d51bf4c3a67, NAME => 'testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,928 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2b9b47d15cdb50b28b74e69ecd7b07e6, NAME => 'testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,928 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => b2c08b25d72243932e8b9f08d12c111c, NAME => 'testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,928 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4df9a62258c4abdc44dd57c5241dd480, NAME => 'testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,928 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => d7f71608b7ab02bc78e2a9ba466c6b90, NAME => 'testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,928 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4043ad074064f04c99a556c4ccb426ba, NAME => 'testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,948 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:13,948 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 04bd3095796b4fbc91a4234923cb02b5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,956 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:13,956 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ef48c2d8aee74cbea8cade7b90abe9f4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,964 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f20203f6558c4cdd90f66ed865fc57cc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,964 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bececfb1641b4b98854376284a461e27 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,972 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:13,972 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 055666132e3745479a3cda8db59ed4c5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,976 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 00b4cdc10938611b392f2d51bf4c3a67, disabling compactions & flushes 2023-02-14 11:02:13,976 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing b2c08b25d72243932e8b9f08d12c111c, disabling compactions & flushes 2023-02-14 11:02:13,976 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:13,976 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:13,976 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:13,976 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:13,976 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. after waiting 0 ms 2023-02-14 11:02:13,976 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:13,976 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. after waiting 0 ms 2023-02-14 11:02:13,976 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:13,976 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:13,976 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for b2c08b25d72243932e8b9f08d12c111c: 2023-02-14 11:02:13,977 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:13,977 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 00b4cdc10938611b392f2d51bf4c3a67: 2023-02-14 11:02:13,977 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 3eed5453f8018cf240a595f4184b5b4c, NAME => 'testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,977 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => face03591dcef4ef3d6e6d4b5fc0c429, NAME => 'testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:13,980 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:13,980 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4043ad074064f04c99a556c4ccb426ba, disabling compactions & flushes 2023-02-14 11:02:13,980 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:13,980 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:13,980 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. after waiting 0 ms 2023-02-14 11:02:13,980 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:13,980 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:13,981 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4043ad074064f04c99a556c4ccb426ba: 2023-02-14 11:02:13,984 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:13,984 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:13,984 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a3b190189dd4ea984c31e7e2e70b0ae from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,984 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f4df1f177a00422dae13062bfb0959e8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,988 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 11a0a7a0a7ae4eeb97096669dea51225 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,989 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:13,989 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1c492818116e48fba82dc2e30e75aefb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,989 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6b9feccedec44e25827f570fa9e93d6f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,991 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:13,991 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a95b323f209c40ef904d4fe95bc7fbd4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,995 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7befb8fc36454f16bd0f4f8afc2910ef from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,996 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing a6edd594895698de5605457161632837, disabling compactions & flushes 2023-02-14 11:02:13,996 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 2b9b47d15cdb50b28b74e69ecd7b07e6, disabling compactions & flushes 2023-02-14 11:02:13,996 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:13,996 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:13,996 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:13,996 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:13,996 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. after waiting 0 ms 2023-02-14 11:02:13,996 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:13,997 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:13,997 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 2b9b47d15cdb50b28b74e69ecd7b07e6: 2023-02-14 11:02:13,996 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. after waiting 0 ms 2023-02-14 11:02:13,997 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a013b05787174995971025c12178f3ef from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:13,997 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:13,997 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:13,997 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for a6edd594895698de5605457161632837: 2023-02-14 11:02:13,997 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b5dc0041fb5a4a74b5ae4b2a85316922 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:14,006 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing d7f71608b7ab02bc78e2a9ba466c6b90, disabling compactions & flushes 2023-02-14 11:02:14,006 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:14,006 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:14,006 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. after waiting 0 ms 2023-02-14 11:02:14,006 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:14,006 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:14,006 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for d7f71608b7ab02bc78e2a9ba466c6b90: 2023-02-14 11:02:14,007 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:14,007 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aeb51e32e20842bc8920f88e67f6c2d7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:14,009 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 38db420affeb6e2972189e2494e70bfd, disabling compactions & flushes 2023-02-14 11:02:14,009 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:14,009 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:14,009 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. after waiting 0 ms 2023-02-14 11:02:14,009 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:14,009 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:14,009 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 38db420affeb6e2972189e2494e70bfd: 2023-02-14 11:02:14,010 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 4df9a62258c4abdc44dd57c5241dd480, disabling compactions & flushes 2023-02-14 11:02:14,010 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:14,010 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:14,010 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. after waiting 0 ms 2023-02-14 11:02:14,010 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:14,010 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:14,010 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 4df9a62258c4abdc44dd57c5241dd480: 2023-02-14 11:02:14,010 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 49bd8b329b5440eab8bebf3e4b431077 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-14 11:02:14,011 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:14,011 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 3eed5453f8018cf240a595f4184b5b4c, disabling compactions & flushes 2023-02-14 11:02:14,011 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:14,011 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:14,011 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. after waiting 0 ms 2023-02-14 11:02:14,011 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:14,011 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:14,011 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 3eed5453f8018cf240a595f4184b5b4c: 2023-02-14 11:02:14,012 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing face03591dcef4ef3d6e6d4b5fc0c429, disabling compactions & flushes 2023-02-14 11:02:14,012 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:14,012 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:14,012 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. after waiting 0 ms 2023-02-14 11:02:14,012 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:14,012 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:14,012 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for face03591dcef4ef3d6e6d4b5fc0c429: 2023-02-14 11:02:14,013 INFO [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676372530913 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:14,013 DEBUG [Listener at localhost/41749] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:14,013 DEBUG [Listener at localhost/41749] util.CommonFSUtils(682): File system contents for path hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3 2023-02-14 11:02:14,014 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-data/ 2023-02-14 11:02:14,014 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----default/ 2023-02-14 11:02:14,015 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-14 11:02:14,015 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------00b4cdc10938611b392f2d51bf4c3a67/ 2023-02-14 11:02:14,016 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,016 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:14,016 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=00b4cdc10938611b392f2d51bf4c3a67-04bd3095796b4fbc91a4234923cb02b5 2023-02-14 11:02:14,017 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:14,017 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=00b4cdc10938611b392f2d51bf4c3a67-f20203f6558c4cdd90f66ed865fc57cc 2023-02-14 11:02:14,017 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------2b9b47d15cdb50b28b74e69ecd7b07e6/ 2023-02-14 11:02:14,018 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,018 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:14,018 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=2b9b47d15cdb50b28b74e69ecd7b07e6-f4df1f177a00422dae13062bfb0959e8 2023-02-14 11:02:14,018 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:14,019 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=2b9b47d15cdb50b28b74e69ecd7b07e6-11a0a7a0a7ae4eeb97096669dea51225 2023-02-14 11:02:14,019 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------38db420affeb6e2972189e2494e70bfd/ 2023-02-14 11:02:14,019 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,020 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:14,020 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=38db420affeb6e2972189e2494e70bfd-1c492818116e48fba82dc2e30e75aefb 2023-02-14 11:02:14,020 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:14,021 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=38db420affeb6e2972189e2494e70bfd-a013b05787174995971025c12178f3ef 2023-02-14 11:02:14,021 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------3eed5453f8018cf240a595f4184b5b4c/ 2023-02-14 11:02:14,021 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,021 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------4043ad074064f04c99a556c4ccb426ba/ 2023-02-14 11:02:14,022 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,022 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------4df9a62258c4abdc44dd57c5241dd480/ 2023-02-14 11:02:14,022 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,023 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:14,023 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=4df9a62258c4abdc44dd57c5241dd480-9a3b190189dd4ea984c31e7e2e70b0ae 2023-02-14 11:02:14,023 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:14,023 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=4df9a62258c4abdc44dd57c5241dd480-7befb8fc36454f16bd0f4f8afc2910ef 2023-02-14 11:02:14,024 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------a6edd594895698de5605457161632837/ 2023-02-14 11:02:14,024 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,024 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:14,025 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=a6edd594895698de5605457161632837-055666132e3745479a3cda8db59ed4c5 2023-02-14 11:02:14,025 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:14,026 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=a6edd594895698de5605457161632837-6b9feccedec44e25827f570fa9e93d6f 2023-02-14 11:02:14,026 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------b2c08b25d72243932e8b9f08d12c111c/ 2023-02-14 11:02:14,026 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,026 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:14,027 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=b2c08b25d72243932e8b9f08d12c111c-ef48c2d8aee74cbea8cade7b90abe9f4 2023-02-14 11:02:14,027 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:14,027 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=b2c08b25d72243932e8b9f08d12c111c-bececfb1641b4b98854376284a461e27 2023-02-14 11:02:14,028 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------d7f71608b7ab02bc78e2a9ba466c6b90/ 2023-02-14 11:02:14,028 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,028 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:14,029 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=d7f71608b7ab02bc78e2a9ba466c6b90-a95b323f209c40ef904d4fe95bc7fbd4 2023-02-14 11:02:14,029 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:14,029 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=d7f71608b7ab02bc78e2a9ba466c6b90-b5dc0041fb5a4a74b5ae4b2a85316922 2023-02-14 11:02:14,029 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |----------face03591dcef4ef3d6e6d4b5fc0c429/ 2023-02-14 11:02:14,030 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:14,030 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:14,031 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=face03591dcef4ef3d6e6d4b5fc0c429-aeb51e32e20842bc8920f88e67f6c2d7 2023-02-14 11:02:14,031 DEBUG [Listener at localhost/41749] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:14,031 DEBUG [Listener at localhost/41749] util.CommonFSUtils(702): |----------------testWithMapReduce=face03591dcef4ef3d6e6d4b5fc0c429-49bd8b329b5440eab8bebf3e4b431077 2023-02-14 11:02:14,032 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:14,033 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:14,033 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:14,034 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:14,935 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop-6606685163197492332.jar 2023-02-14 11:02:14,936 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:14,936 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:15,002 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop-1399613059087132849.jar 2023-02-14 11:02:15,002 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:15,003 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:15,004 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:15,004 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:15,005 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:15,005 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:15,005 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-14 11:02:15,006 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-14 11:02:15,006 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-14 11:02:15,007 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-14 11:02:15,007 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-14 11:02:15,008 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-14 11:02:15,008 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-14 11:02:15,008 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-14 11:02:15,009 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-14 11:02:15,009 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-14 11:02:15,010 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:15,010 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-14 11:02:15,010 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-14 11:02:15,011 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-14 11:02:15,011 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-14 11:02:15,077 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop-1279328301073950936.jar 2023-02-14 11:02:15,078 DEBUG [Listener at localhost/41749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-14 11:02:15,083 WARN [Listener at localhost/41749] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-14 11:02:15,088 WARN [Listener at localhost/41749] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-14 11:02:15,095 INFO [Listener at localhost/41749] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-14 11:02:15,189 WARN [Listener at localhost/41749] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/mapreduce.cluster.local.dir/1676372535158/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-14 11:02:15,189 WARN [Listener at localhost/41749] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/mapreduce.cluster.local.dir/1676372535158/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-14 11:02:15,236 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,236 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,237 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,238 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:15,240 DEBUG [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba/f1 2023-02-14 11:02:15,240 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4043ad074064f04c99a556c4ccb426ba columnFamilyName f1 2023-02-14 11:02:15,241 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] regionserver.HStore(310): Store=4043ad074064f04c99a556c4ccb426ba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,241 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4043ad074064f04c99a556c4ccb426ba 2023-02-14 11:02:15,242 DEBUG [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/4043ad074064f04c99a556c4ccb426ba/f2 2023-02-14 11:02:15,242 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4043ad074064f04c99a556c4ccb426ba columnFamilyName f2 2023-02-14 11:02:15,243 INFO [StoreOpener-4043ad074064f04c99a556c4ccb426ba-1] regionserver.HStore(310): Store=4043ad074064f04c99a556c4ccb426ba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,243 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,243 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4043ad074064f04c99a556c4ccb426ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70141925, jitterRate=0.045196130871772766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,243 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4043ad074064f04c99a556c4ccb426ba: 2023-02-14 11:02:15,262 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4043ad074064f04c99a556c4ccb426ba, disabling compactions & flushes 2023-02-14 11:02:15,263 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:15,263 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:15,263 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. after waiting 0 ms 2023-02-14 11:02:15,263 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:15,263 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676372529576.4043ad074064f04c99a556c4ccb426ba. 2023-02-14 11:02:15,263 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4043ad074064f04c99a556c4ccb426ba: 2023-02-14 11:02:15,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,267 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,268 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,269 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:15,270 DEBUG [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1 2023-02-14 11:02:15,270 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38db420affeb6e2972189e2494e70bfd columnFamilyName f1 2023-02-14 11:02:15,276 DEBUG [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f1/testWithMapReduce=38db420affeb6e2972189e2494e70bfd-1c492818116e48fba82dc2e30e75aefb 2023-02-14 11:02:15,276 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(310): Store=38db420affeb6e2972189e2494e70bfd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,276 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 38db420affeb6e2972189e2494e70bfd 2023-02-14 11:02:15,277 DEBUG [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2 2023-02-14 11:02:15,277 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38db420affeb6e2972189e2494e70bfd columnFamilyName f2 2023-02-14 11:02:15,283 DEBUG [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/38db420affeb6e2972189e2494e70bfd/f2/testWithMapReduce=38db420affeb6e2972189e2494e70bfd-a013b05787174995971025c12178f3ef 2023-02-14 11:02:15,283 INFO [StoreOpener-38db420affeb6e2972189e2494e70bfd-1] regionserver.HStore(310): Store=38db420affeb6e2972189e2494e70bfd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,284 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 38db420affeb6e2972189e2494e70bfd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70283196, jitterRate=0.04730123281478882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 38db420affeb6e2972189e2494e70bfd: 2023-02-14 11:02:15,321 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 38db420affeb6e2972189e2494e70bfd, disabling compactions & flushes 2023-02-14 11:02:15,321 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:15,321 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:15,321 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. after waiting 0 ms 2023-02-14 11:02:15,321 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:15,322 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676372529576.38db420affeb6e2972189e2494e70bfd. 2023-02-14 11:02:15,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 38db420affeb6e2972189e2494e70bfd: 2023-02-14 11:02:15,325 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,325 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,327 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,328 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:15,329 DEBUG [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1 2023-02-14 11:02:15,330 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00b4cdc10938611b392f2d51bf4c3a67 columnFamilyName f1 2023-02-14 11:02:15,335 DEBUG [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f1/testWithMapReduce=00b4cdc10938611b392f2d51bf4c3a67-04bd3095796b4fbc91a4234923cb02b5 2023-02-14 11:02:15,335 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(310): Store=00b4cdc10938611b392f2d51bf4c3a67/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,335 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00b4cdc10938611b392f2d51bf4c3a67 2023-02-14 11:02:15,336 DEBUG [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2 2023-02-14 11:02:15,337 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00b4cdc10938611b392f2d51bf4c3a67 columnFamilyName f2 2023-02-14 11:02:15,342 DEBUG [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/00b4cdc10938611b392f2d51bf4c3a67/f2/testWithMapReduce=00b4cdc10938611b392f2d51bf4c3a67-f20203f6558c4cdd90f66ed865fc57cc 2023-02-14 11:02:15,342 INFO [StoreOpener-00b4cdc10938611b392f2d51bf4c3a67-1] regionserver.HStore(310): Store=00b4cdc10938611b392f2d51bf4c3a67/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,342 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,342 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 00b4cdc10938611b392f2d51bf4c3a67; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70131974, jitterRate=0.04504784941673279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,342 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 00b4cdc10938611b392f2d51bf4c3a67: 2023-02-14 11:02:15,370 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 00b4cdc10938611b392f2d51bf4c3a67, disabling compactions & flushes 2023-02-14 11:02:15,370 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:15,371 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:15,371 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. after waiting 0 ms 2023-02-14 11:02:15,371 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:15,371 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676372529576.00b4cdc10938611b392f2d51bf4c3a67. 2023-02-14 11:02:15,371 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 00b4cdc10938611b392f2d51bf4c3a67: 2023-02-14 11:02:15,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,375 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,377 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,379 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:15,380 DEBUG [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1 2023-02-14 11:02:15,381 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b9b47d15cdb50b28b74e69ecd7b07e6 columnFamilyName f1 2023-02-14 11:02:15,386 DEBUG [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f1/testWithMapReduce=2b9b47d15cdb50b28b74e69ecd7b07e6-f4df1f177a00422dae13062bfb0959e8 2023-02-14 11:02:15,386 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(310): Store=2b9b47d15cdb50b28b74e69ecd7b07e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,387 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2b9b47d15cdb50b28b74e69ecd7b07e6 2023-02-14 11:02:15,387 DEBUG [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2 2023-02-14 11:02:15,388 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b9b47d15cdb50b28b74e69ecd7b07e6 columnFamilyName f2 2023-02-14 11:02:15,392 DEBUG [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/2b9b47d15cdb50b28b74e69ecd7b07e6/f2/testWithMapReduce=2b9b47d15cdb50b28b74e69ecd7b07e6-11a0a7a0a7ae4eeb97096669dea51225 2023-02-14 11:02:15,393 INFO [StoreOpener-2b9b47d15cdb50b28b74e69ecd7b07e6-1] regionserver.HStore(310): Store=2b9b47d15cdb50b28b74e69ecd7b07e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,393 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2b9b47d15cdb50b28b74e69ecd7b07e6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70795105, jitterRate=0.05492927134037018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2b9b47d15cdb50b28b74e69ecd7b07e6: 2023-02-14 11:02:15,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2b9b47d15cdb50b28b74e69ecd7b07e6, disabling compactions & flushes 2023-02-14 11:02:15,433 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:15,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:15,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. after waiting 0 ms 2023-02-14 11:02:15,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:15,434 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676372529576.2b9b47d15cdb50b28b74e69ecd7b07e6. 2023-02-14 11:02:15,434 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2b9b47d15cdb50b28b74e69ecd7b07e6: 2023-02-14 11:02:15,438 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,438 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,440 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,441 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:15,443 DEBUG [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c/f1 2023-02-14 11:02:15,443 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eed5453f8018cf240a595f4184b5b4c columnFamilyName f1 2023-02-14 11:02:15,443 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] regionserver.HStore(310): Store=3eed5453f8018cf240a595f4184b5b4c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,444 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3eed5453f8018cf240a595f4184b5b4c 2023-02-14 11:02:15,445 DEBUG [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/3eed5453f8018cf240a595f4184b5b4c/f2 2023-02-14 11:02:15,445 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eed5453f8018cf240a595f4184b5b4c columnFamilyName f2 2023-02-14 11:02:15,446 INFO [StoreOpener-3eed5453f8018cf240a595f4184b5b4c-1] regionserver.HStore(310): Store=3eed5453f8018cf240a595f4184b5b4c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3eed5453f8018cf240a595f4184b5b4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66404197, jitterRate=-0.010500356554985046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3eed5453f8018cf240a595f4184b5b4c: 2023-02-14 11:02:15,464 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3eed5453f8018cf240a595f4184b5b4c, disabling compactions & flushes 2023-02-14 11:02:15,464 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:15,464 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:15,464 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. after waiting 0 ms 2023-02-14 11:02:15,464 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:15,465 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372529576.3eed5453f8018cf240a595f4184b5b4c. 2023-02-14 11:02:15,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3eed5453f8018cf240a595f4184b5b4c: 2023-02-14 11:02:15,469 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,469 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,471 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,472 INFO [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a6edd594895698de5605457161632837 2023-02-14 11:02:15,473 DEBUG [StoreOpener-a6edd594895698de5605457161632837-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1 2023-02-14 11:02:15,474 INFO [StoreOpener-a6edd594895698de5605457161632837-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6edd594895698de5605457161632837 columnFamilyName f1 2023-02-14 11:02:15,480 DEBUG [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f1/testWithMapReduce=a6edd594895698de5605457161632837-055666132e3745479a3cda8db59ed4c5 2023-02-14 11:02:15,480 INFO [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(310): Store=a6edd594895698de5605457161632837/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,480 INFO [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a6edd594895698de5605457161632837 2023-02-14 11:02:15,481 DEBUG [StoreOpener-a6edd594895698de5605457161632837-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2 2023-02-14 11:02:15,481 INFO [StoreOpener-a6edd594895698de5605457161632837-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6edd594895698de5605457161632837 columnFamilyName f2 2023-02-14 11:02:15,485 DEBUG [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/a6edd594895698de5605457161632837/f2/testWithMapReduce=a6edd594895698de5605457161632837-6b9feccedec44e25827f570fa9e93d6f 2023-02-14 11:02:15,485 INFO [StoreOpener-a6edd594895698de5605457161632837-1] regionserver.HStore(310): Store=a6edd594895698de5605457161632837/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,485 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,485 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a6edd594895698de5605457161632837; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69196958, jitterRate=0.031115025281906128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,485 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a6edd594895698de5605457161632837: 2023-02-14 11:02:15,517 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a6edd594895698de5605457161632837, disabling compactions & flushes 2023-02-14 11:02:15,517 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:15,517 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:15,517 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. after waiting 0 ms 2023-02-14 11:02:15,517 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:15,518 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676372529576.a6edd594895698de5605457161632837. 2023-02-14 11:02:15,518 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a6edd594895698de5605457161632837: 2023-02-14 11:02:15,521 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,521 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,522 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,523 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:15,524 DEBUG [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1 2023-02-14 11:02:15,524 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region face03591dcef4ef3d6e6d4b5fc0c429 columnFamilyName f1 2023-02-14 11:02:15,529 DEBUG [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f1/testWithMapReduce=face03591dcef4ef3d6e6d4b5fc0c429-aeb51e32e20842bc8920f88e67f6c2d7 2023-02-14 11:02:15,530 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(310): Store=face03591dcef4ef3d6e6d4b5fc0c429/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,530 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region face03591dcef4ef3d6e6d4b5fc0c429 2023-02-14 11:02:15,530 DEBUG [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2 2023-02-14 11:02:15,531 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region face03591dcef4ef3d6e6d4b5fc0c429 columnFamilyName f2 2023-02-14 11:02:15,536 DEBUG [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/face03591dcef4ef3d6e6d4b5fc0c429/f2/testWithMapReduce=face03591dcef4ef3d6e6d4b5fc0c429-49bd8b329b5440eab8bebf3e4b431077 2023-02-14 11:02:15,536 INFO [StoreOpener-face03591dcef4ef3d6e6d4b5fc0c429-1] regionserver.HStore(310): Store=face03591dcef4ef3d6e6d4b5fc0c429/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,536 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,536 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened face03591dcef4ef3d6e6d4b5fc0c429; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68053823, jitterRate=0.014080986380577087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,536 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for face03591dcef4ef3d6e6d4b5fc0c429: 2023-02-14 11:02:15,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing face03591dcef4ef3d6e6d4b5fc0c429, disabling compactions & flushes 2023-02-14 11:02:15,564 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:15,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:15,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. after waiting 0 ms 2023-02-14 11:02:15,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:15,565 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676372529576.face03591dcef4ef3d6e6d4b5fc0c429. 2023-02-14 11:02:15,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for face03591dcef4ef3d6e6d4b5fc0c429: 2023-02-14 11:02:15,568 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,568 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,569 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,572 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:15,573 DEBUG [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1 2023-02-14 11:02:15,573 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7f71608b7ab02bc78e2a9ba466c6b90 columnFamilyName f1 2023-02-14 11:02:15,579 DEBUG [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f1/testWithMapReduce=d7f71608b7ab02bc78e2a9ba466c6b90-a95b323f209c40ef904d4fe95bc7fbd4 2023-02-14 11:02:15,579 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(310): Store=d7f71608b7ab02bc78e2a9ba466c6b90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,579 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d7f71608b7ab02bc78e2a9ba466c6b90 2023-02-14 11:02:15,580 DEBUG [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2 2023-02-14 11:02:15,580 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7f71608b7ab02bc78e2a9ba466c6b90 columnFamilyName f2 2023-02-14 11:02:15,585 DEBUG [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/d7f71608b7ab02bc78e2a9ba466c6b90/f2/testWithMapReduce=d7f71608b7ab02bc78e2a9ba466c6b90-b5dc0041fb5a4a74b5ae4b2a85316922 2023-02-14 11:02:15,585 INFO [StoreOpener-d7f71608b7ab02bc78e2a9ba466c6b90-1] regionserver.HStore(310): Store=d7f71608b7ab02bc78e2a9ba466c6b90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,585 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,585 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d7f71608b7ab02bc78e2a9ba466c6b90; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67808385, jitterRate=0.010423675179481506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d7f71608b7ab02bc78e2a9ba466c6b90: 2023-02-14 11:02:15,626 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d7f71608b7ab02bc78e2a9ba466c6b90, disabling compactions & flushes 2023-02-14 11:02:15,626 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:15,626 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:15,626 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. after waiting 0 ms 2023-02-14 11:02:15,626 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:15,627 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676372529576.d7f71608b7ab02bc78e2a9ba466c6b90. 2023-02-14 11:02:15,627 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d7f71608b7ab02bc78e2a9ba466c6b90: 2023-02-14 11:02:15,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,631 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,633 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,635 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:15,636 DEBUG [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1 2023-02-14 11:02:15,636 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4df9a62258c4abdc44dd57c5241dd480 columnFamilyName f1 2023-02-14 11:02:15,640 DEBUG [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f1/testWithMapReduce=4df9a62258c4abdc44dd57c5241dd480-9a3b190189dd4ea984c31e7e2e70b0ae 2023-02-14 11:02:15,640 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(310): Store=4df9a62258c4abdc44dd57c5241dd480/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,640 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4df9a62258c4abdc44dd57c5241dd480 2023-02-14 11:02:15,641 DEBUG [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2 2023-02-14 11:02:15,641 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4df9a62258c4abdc44dd57c5241dd480 columnFamilyName f2 2023-02-14 11:02:15,647 DEBUG [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/4df9a62258c4abdc44dd57c5241dd480/f2/testWithMapReduce=4df9a62258c4abdc44dd57c5241dd480-7befb8fc36454f16bd0f4f8afc2910ef 2023-02-14 11:02:15,647 INFO [StoreOpener-4df9a62258c4abdc44dd57c5241dd480-1] regionserver.HStore(310): Store=4df9a62258c4abdc44dd57c5241dd480/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,647 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,647 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4df9a62258c4abdc44dd57c5241dd480; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65352968, jitterRate=-0.026164889335632324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,647 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4df9a62258c4abdc44dd57c5241dd480: 2023-02-14 11:02:15,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4df9a62258c4abdc44dd57c5241dd480, disabling compactions & flushes 2023-02-14 11:02:15,681 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:15,681 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:15,681 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. after waiting 0 ms 2023-02-14 11:02:15,681 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:15,682 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676372529576.4df9a62258c4abdc44dd57c5241dd480. 2023-02-14 11:02:15,682 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4df9a62258c4abdc44dd57c5241dd480: 2023-02-14 11:02:15,684 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:15,685 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:15,686 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:15,689 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:15,690 DEBUG [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1 2023-02-14 11:02:15,690 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2c08b25d72243932e8b9f08d12c111c columnFamilyName f1 2023-02-14 11:02:15,698 DEBUG [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f1/testWithMapReduce=b2c08b25d72243932e8b9f08d12c111c-ef48c2d8aee74cbea8cade7b90abe9f4 2023-02-14 11:02:15,698 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(310): Store=b2c08b25d72243932e8b9f08d12c111c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,698 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b2c08b25d72243932e8b9f08d12c111c 2023-02-14 11:02:15,699 DEBUG [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2 2023-02-14 11:02:15,699 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2c08b25d72243932e8b9f08d12c111c columnFamilyName f2 2023-02-14 11:02:15,703 DEBUG [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(539): loaded hdfs://localhost:32885/user/jenkins/test-data/895f0878-e4ef-430c-f931-50ea89224ba4/testWithMapReduceAndOfflineHBaseMultiRegion/8a1cc3e8-7ab9-4261-bc5a-a4d0d75628d3/data/default/testWithMapReduce/b2c08b25d72243932e8b9f08d12c111c/f2/testWithMapReduce=b2c08b25d72243932e8b9f08d12c111c-bececfb1641b4b98854376284a461e27 2023-02-14 11:02:15,703 INFO [StoreOpener-b2c08b25d72243932e8b9f08d12c111c-1] regionserver.HStore(310): Store=b2c08b25d72243932e8b9f08d12c111c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:15,703 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:15,704 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b2c08b25d72243932e8b9f08d12c111c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66873767, jitterRate=-0.0035032182931900024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:15,704 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b2c08b25d72243932e8b9f08d12c111c: 2023-02-14 11:02:15,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b2c08b25d72243932e8b9f08d12c111c, disabling compactions & flushes 2023-02-14 11:02:15,732 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:15,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:15,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. after waiting 0 ms 2023-02-14 11:02:15,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:15,733 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676372529576.b2c08b25d72243932e8b9f08d12c111c. 2023-02-14 11:02:15,733 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b2c08b25d72243932e8b9f08d12c111c: 2023-02-14 11:02:16,016 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-14 11:02:16,237 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-14 11:02:16,237 WARN [Listener at localhost/41749] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:16,240 INFO [Listener at localhost/41749] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:16,345 WARN [BP-926614298-172.31.14.131-1676372526744 heartbeating to localhost/127.0.0.1:32885] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:16,345 WARN [BP-926614298-172.31.14.131-1676372526744 heartbeating to localhost/127.0.0.1:32885] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-926614298-172.31.14.131-1676372526744 (Datanode Uuid af3cd61a-e66c-4db4-9bd4-ba42cfd735ed) service to localhost/127.0.0.1:32885 2023-02-14 11:02:16,346 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/cluster_5e6e037c-2d82-8d7e-6615-77ac58c3ffbe/dfs/data/data3/current/BP-926614298-172.31.14.131-1676372526744] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:16,347 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/cluster_5e6e037c-2d82-8d7e-6615-77ac58c3ffbe/dfs/data/data4/current/BP-926614298-172.31.14.131-1676372526744] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:16,347 WARN [Listener at localhost/41749] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:16,353 INFO [Listener at localhost/41749] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:16,457 WARN [BP-926614298-172.31.14.131-1676372526744 heartbeating to localhost/127.0.0.1:32885] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:16,457 WARN [BP-926614298-172.31.14.131-1676372526744 heartbeating to localhost/127.0.0.1:32885] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-926614298-172.31.14.131-1676372526744 (Datanode Uuid bc58fce3-3593-440f-abe2-bff7acc1189f) service to localhost/127.0.0.1:32885 2023-02-14 11:02:16,457 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/cluster_5e6e037c-2d82-8d7e-6615-77ac58c3ffbe/dfs/data/data1/current/BP-926614298-172.31.14.131-1676372526744] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:16,458 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/cluster_5e6e037c-2d82-8d7e-6615-77ac58c3ffbe/dfs/data/data2/current/BP-926614298-172.31.14.131-1676372526744] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:16,467 INFO [Listener at localhost/41749] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:16,587 INFO [Listener at localhost/41749] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-14 11:02:16,645 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-14 11:02:16,658 INFO [Listener at localhost/41749] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=155 (was 104) Potentially hanging thread: (jenkins-hbase4.apache.org,40109,1676372527540)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:32885 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41749 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:32885 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:32885 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:32885 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:32885 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:32885 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:32885 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=542 (was 535) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=298 (was 289) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5812 (was 6020) 2023-02-14 11:02:16,668 INFO [Listener at localhost/41749] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=155, OpenFileDescriptor=542, MaxFileDescriptor=60000, SystemLoadAverage=298, ProcessCount=168, AvailableMemoryMB=5811 2023-02-14 11:02:16,678 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop.log.dir so I do NOT create it in target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e 2023-02-14 11:02:16,678 WARN [Listener at localhost/41749] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop.log.dir Erasing configuration value by system value. 2023-02-14 11:02:16,678 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop.tmp.dir so I do NOT create it in target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e 2023-02-14 11:02:16,678 WARN [Listener at localhost/41749] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2197fb2-b6cd-a6f0-5412-d88b28509b9a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-14 11:02:16,678 DEBUG [Listener at localhost/41749] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e 2023-02-14 11:02:16,678 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-14 11:02:16,679 INFO [Listener at localhost/41749] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/cluster_75ebddf1-5c55-b195-4320-3c9e48205cbf, deleteOnExit=true 2023-02-14 11:02:16,679 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-14 11:02:16,679 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/test.cache.data in system properties and HBase conf 2023-02-14 11:02:16,679 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/hadoop.tmp.dir in system properties and HBase conf 2023-02-14 11:02:16,679 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/hadoop.log.dir in system properties and HBase conf 2023-02-14 11:02:16,679 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-14 11:02:16,679 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-14 11:02:16,679 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-14 11:02:16,679 DEBUG [Listener at localhost/41749] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-14 11:02:16,680 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/nfs.dump.dir in system properties and HBase conf 2023-02-14 11:02:16,681 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/java.io.tmpdir in system properties and HBase conf 2023-02-14 11:02:16,681 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:16,681 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-14 11:02:16,681 INFO [Listener at localhost/41749] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-14 11:02:16,685 WARN [Listener at localhost/41749] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:16,685 WARN [Listener at localhost/41749] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:16,728 WARN [Listener at localhost/41749] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:16,730 INFO [Listener at localhost/41749] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:16,736 INFO [Listener at localhost/41749] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/java.io.tmpdir/Jetty_localhost_36349_hdfs____.oudbq9/webapp 2023-02-14 11:02:16,829 INFO [Listener at localhost/41749] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36349 2023-02-14 11:02:16,833 WARN [Listener at localhost/41749] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:16,833 WARN [Listener at localhost/41749] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:16,876 WARN [Listener at localhost/43675] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:16,886 WARN [Listener at localhost/43675] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:16,889 WARN [Listener at localhost/43675] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:16,890 INFO [Listener at localhost/43675] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:16,896 INFO [Listener at localhost/43675] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/java.io.tmpdir/Jetty_localhost_33613_datanode____l2lt9b/webapp 2023-02-14 11:02:17,054 INFO [Listener at localhost/43675] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33613 2023-02-14 11:02:17,061 WARN [Listener at localhost/44467] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:17,151 WARN [Listener at localhost/44467] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:17,154 WARN [Listener at localhost/44467] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:17,155 INFO [Listener at localhost/44467] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:17,159 INFO [Listener at localhost/44467] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/java.io.tmpdir/Jetty_localhost_36157_datanode____vbk01j/webapp 2023-02-14 11:02:17,205 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe373ab984a36bbce: Processing first storage report for DS-9e257492-8f13-4388-b76a-4aca6ff993af from datanode 007459e0-5632-4c92-9ca6-faf2d132ed2b 2023-02-14 11:02:17,205 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe373ab984a36bbce: from storage DS-9e257492-8f13-4388-b76a-4aca6ff993af node DatanodeRegistration(127.0.0.1:38739, datanodeUuid=007459e0-5632-4c92-9ca6-faf2d132ed2b, infoPort=36605, infoSecurePort=0, ipcPort=44467, storageInfo=lv=-57;cid=testClusterID;nsid=1050489078;c=1676372536687), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:17,205 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe373ab984a36bbce: Processing first storage report for DS-724916ae-b394-4073-b28b-975824e6139c from datanode 007459e0-5632-4c92-9ca6-faf2d132ed2b 2023-02-14 11:02:17,205 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe373ab984a36bbce: from storage DS-724916ae-b394-4073-b28b-975824e6139c node DatanodeRegistration(127.0.0.1:38739, datanodeUuid=007459e0-5632-4c92-9ca6-faf2d132ed2b, infoPort=36605, infoSecurePort=0, ipcPort=44467, storageInfo=lv=-57;cid=testClusterID;nsid=1050489078;c=1676372536687), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:17,265 INFO [Listener at localhost/44467] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36157 2023-02-14 11:02:17,278 WARN [Listener at localhost/38369] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:17,436 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xabe070a3a8ead198: Processing first storage report for DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21 from datanode 9c685bb6-c66c-49f4-976f-65fb5c89cdd8 2023-02-14 11:02:17,436 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xabe070a3a8ead198: from storage DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21 node DatanodeRegistration(127.0.0.1:40865, datanodeUuid=9c685bb6-c66c-49f4-976f-65fb5c89cdd8, infoPort=46277, infoSecurePort=0, ipcPort=38369, storageInfo=lv=-57;cid=testClusterID;nsid=1050489078;c=1676372536687), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:17,436 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xabe070a3a8ead198: Processing first storage report for DS-442388ea-286c-48d0-8720-6154ae491248 from datanode 9c685bb6-c66c-49f4-976f-65fb5c89cdd8 2023-02-14 11:02:17,436 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xabe070a3a8ead198: from storage DS-442388ea-286c-48d0-8720-6154ae491248 node DatanodeRegistration(127.0.0.1:40865, datanodeUuid=9c685bb6-c66c-49f4-976f-65fb5c89cdd8, infoPort=46277, infoSecurePort=0, ipcPort=38369, storageInfo=lv=-57;cid=testClusterID;nsid=1050489078;c=1676372536687), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:17,509 DEBUG [Listener at localhost/38369] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e 2023-02-14 11:02:17,511 INFO [Listener at localhost/38369] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/cluster_75ebddf1-5c55-b195-4320-3c9e48205cbf/zookeeper_0, clientPort=57254, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/cluster_75ebddf1-5c55-b195-4320-3c9e48205cbf/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/cluster_75ebddf1-5c55-b195-4320-3c9e48205cbf/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-14 11:02:17,512 INFO [Listener at localhost/38369] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57254 2023-02-14 11:02:17,512 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,513 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,525 INFO [Listener at localhost/38369] util.FSUtils(479): Created version file at hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf with version=8 2023-02-14 11:02:17,526 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,526 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,528 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43675/user/jenkins/test-data/99e76430-574a-7710-c3b0-7faadb1b63de/hbase-staging 2023-02-14 11:02:17,529 INFO [Listener at localhost/38369] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:17,529 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:17,529 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:17,530 INFO [Listener at localhost/38369] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:17,530 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:17,530 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:17,530 INFO [Listener at localhost/38369] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:17,531 INFO [Listener at localhost/38369] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42293 2023-02-14 11:02:17,531 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,532 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,533 INFO [Listener at localhost/38369] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42293 connecting to ZooKeeper ensemble=127.0.0.1:57254 2023-02-14 11:02:17,542 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:422930x0, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:17,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42293-0x100527eda6b0000 connected 2023-02-14 11:02:17,566 DEBUG [Listener at localhost/38369] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:17,566 DEBUG [Listener at localhost/38369] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:17,567 DEBUG [Listener at localhost/38369] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:17,567 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42293 2023-02-14 11:02:17,567 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42293 2023-02-14 11:02:17,569 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42293 2023-02-14 11:02:17,569 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42293 2023-02-14 11:02:17,570 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42293 2023-02-14 11:02:17,570 INFO [Listener at localhost/38369] master.HMaster(444): hbase.rootdir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf, hbase.cluster.distributed=false 2023-02-14 11:02:17,582 INFO [Listener at localhost/38369] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:17,583 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:17,583 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:17,583 INFO [Listener at localhost/38369] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:17,583 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:17,583 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:17,583 INFO [Listener at localhost/38369] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:17,585 INFO [Listener at localhost/38369] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34921 2023-02-14 11:02:17,585 INFO [Listener at localhost/38369] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:17,588 DEBUG [Listener at localhost/38369] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:17,589 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,590 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,591 INFO [Listener at localhost/38369] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34921 connecting to ZooKeeper ensemble=127.0.0.1:57254 2023-02-14 11:02:17,594 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:349210x0, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:17,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34921-0x100527eda6b0001 connected 2023-02-14 11:02:17,596 DEBUG [Listener at localhost/38369] zookeeper.ZKUtil(164): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:17,596 DEBUG [Listener at localhost/38369] zookeeper.ZKUtil(164): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:17,597 DEBUG [Listener at localhost/38369] zookeeper.ZKUtil(164): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:17,598 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34921 2023-02-14 11:02:17,600 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34921 2023-02-14 11:02:17,604 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34921 2023-02-14 11:02:17,604 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34921 2023-02-14 11:02:17,604 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34921 2023-02-14 11:02:17,618 INFO [Listener at localhost/38369] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:17,618 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:17,618 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:17,618 INFO [Listener at localhost/38369] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:17,618 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:17,618 INFO [Listener at localhost/38369] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:17,618 INFO [Listener at localhost/38369] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:17,622 INFO [Listener at localhost/38369] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41789 2023-02-14 11:02:17,622 INFO [Listener at localhost/38369] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:17,623 DEBUG [Listener at localhost/38369] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:17,624 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,624 INFO [Listener at localhost/38369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,625 INFO [Listener at localhost/38369] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41789 connecting to ZooKeeper ensemble=127.0.0.1:57254 2023-02-14 11:02:17,628 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:417890x0, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:17,630 DEBUG [Listener at localhost/38369] zookeeper.ZKUtil(164): regionserver:417890x0, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:17,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41789-0x100527eda6b0002 connected 2023-02-14 11:02:17,631 DEBUG [Listener at localhost/38369] zookeeper.ZKUtil(164): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:17,632 DEBUG [Listener at localhost/38369] zookeeper.ZKUtil(164): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:17,632 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41789 2023-02-14 11:02:17,632 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41789 2023-02-14 11:02:17,633 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41789 2023-02-14 11:02:17,636 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41789 2023-02-14 11:02:17,636 DEBUG [Listener at localhost/38369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41789 2023-02-14 11:02:17,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:17,642 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:17,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:17,644 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:17,644 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:17,645 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:17,645 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:17,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:17,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42293,1676372537529 from backup master directory 2023-02-14 11:02:17,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:17,648 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:17,648 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:17,648 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:17,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:17,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/hbase.id with ID: 5b008c88-a676-4ac2-bbb3-37fe3638319f 2023-02-14 11:02:17,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:17,675 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:17,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1e73fbdb to 127.0.0.1:57254 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:17,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bf13dd4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:17,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:17,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-14 11:02:17,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:17,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/data/master/store-tmp 2023-02-14 11:02:17,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:17,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:17,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:17,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:17,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:17,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:17,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:17,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:17,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/WALs/jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:17,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42293%2C1676372537529, suffix=, logDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/WALs/jenkins-hbase4.apache.org,42293,1676372537529, archiveDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/oldWALs, maxLogs=10 2023-02-14 11:02:17,729 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38739,DS-9e257492-8f13-4388-b76a-4aca6ff993af,DISK] 2023-02-14 11:02:17,729 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40865,DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21,DISK] 2023-02-14 11:02:17,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/WALs/jenkins-hbase4.apache.org,42293,1676372537529/jenkins-hbase4.apache.org%2C42293%2C1676372537529.1676372537708 2023-02-14 11:02:17,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38739,DS-9e257492-8f13-4388-b76a-4aca6ff993af,DISK], DatanodeInfoWithStorage[127.0.0.1:40865,DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21,DISK]] 2023-02-14 11:02:17,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:17,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:17,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:17,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:17,736 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:17,737 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-14 11:02:17,738 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-14 11:02:17,738 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:17,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:17,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:17,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:17,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:17,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58813135, jitterRate=-0.12361599504947662}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:17,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:17,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-14 11:02:17,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-14 11:02:17,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-14 11:02:17,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-14 11:02:17,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-14 11:02:17,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-14 11:02:17,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-14 11:02:17,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-14 11:02:17,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-14 11:02:17,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-14 11:02:17,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-14 11:02:17,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-14 11:02:17,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-14 11:02:17,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-14 11:02:17,762 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:17,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-14 11:02:17,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-14 11:02:17,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-14 11:02:17,765 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:17,765 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:17,765 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:17,765 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:17,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42293,1676372537529, sessionid=0x100527eda6b0000, setting cluster-up flag (Was=false) 2023-02-14 11:02:17,770 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:17,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-14 11:02:17,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:17,786 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:17,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-14 11:02:17,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:17,791 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.hbase-snapshot/.tmp 2023-02-14 11:02:17,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:17,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:17,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:17,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:17,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:17,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-14 11:02:17,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:17,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676372567796 2023-02-14 11:02:17,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-14 11:02:17,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-14 11:02:17,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-14 11:02:17,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-14 11:02:17,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-14 11:02:17,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-14 11:02:17,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-14 11:02:17,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-14 11:02:17,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-14 11:02:17,798 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:17,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-14 11:02:17,798 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-14 11:02:17,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-14 11:02:17,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372537798,5,FailOnTimeoutGroup] 2023-02-14 11:02:17,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372537798,5,FailOnTimeoutGroup] 2023-02-14 11:02:17,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-14 11:02:17,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,799 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:17,812 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:17,812 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:17,812 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf 2023-02-14 11:02:17,819 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:17,820 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:17,821 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/info 2023-02-14 11:02:17,821 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:17,822 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:17,822 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:17,823 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:17,823 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:17,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:17,824 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:17,824 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/table 2023-02-14 11:02:17,825 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:17,825 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:17,826 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740 2023-02-14 11:02:17,826 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740 2023-02-14 11:02:17,827 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:17,828 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:17,830 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:17,830 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67746048, jitterRate=0.009494781494140625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:17,830 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:17,830 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:17,830 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:17,830 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:17,830 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:17,830 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:17,830 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:17,830 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:17,831 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:17,831 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-14 11:02:17,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-14 11:02:17,833 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-14 11:02:17,834 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-14 11:02:17,842 INFO [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(952): ClusterId : 5b008c88-a676-4ac2-bbb3-37fe3638319f 2023-02-14 11:02:17,842 INFO [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(952): ClusterId : 5b008c88-a676-4ac2-bbb3-37fe3638319f 2023-02-14 11:02:17,842 DEBUG [RS:1;jenkins-hbase4:41789] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:17,842 DEBUG [RS:0;jenkins-hbase4:34921] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:17,845 DEBUG [RS:1;jenkins-hbase4:41789] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:17,845 DEBUG [RS:1;jenkins-hbase4:41789] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:17,845 DEBUG [RS:0;jenkins-hbase4:34921] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:17,845 DEBUG [RS:0;jenkins-hbase4:34921] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:17,847 DEBUG [RS:1;jenkins-hbase4:41789] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:17,848 DEBUG [RS:0;jenkins-hbase4:34921] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:17,849 DEBUG [RS:1;jenkins-hbase4:41789] zookeeper.ReadOnlyZKClient(139): Connect 0x5c4bfeb3 to 127.0.0.1:57254 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:17,849 DEBUG [RS:0;jenkins-hbase4:34921] zookeeper.ReadOnlyZKClient(139): Connect 0x541ba805 to 127.0.0.1:57254 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:17,893 DEBUG [RS:1;jenkins-hbase4:41789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@528c0b4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:17,893 DEBUG [RS:1;jenkins-hbase4:41789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56b395c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:17,896 DEBUG [RS:0;jenkins-hbase4:34921] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5adc5cf6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:17,896 DEBUG [RS:0;jenkins-hbase4:34921] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ee3c375, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:17,902 DEBUG [RS:1;jenkins-hbase4:41789] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41789 2023-02-14 11:02:17,902 INFO [RS:1;jenkins-hbase4:41789] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:17,902 INFO [RS:1;jenkins-hbase4:41789] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:17,902 DEBUG [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:17,902 INFO [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42293,1676372537529 with isa=jenkins-hbase4.apache.org/172.31.14.131:41789, startcode=1676372537618 2023-02-14 11:02:17,902 DEBUG [RS:1;jenkins-hbase4:41789] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:17,904 DEBUG [RS:0;jenkins-hbase4:34921] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34921 2023-02-14 11:02:17,904 INFO [RS:0;jenkins-hbase4:34921] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:17,904 INFO [RS:0;jenkins-hbase4:34921] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:17,904 DEBUG [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:17,904 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36769, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:17,905 INFO [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42293,1676372537529 with isa=jenkins-hbase4.apache.org/172.31.14.131:34921, startcode=1676372537582 2023-02-14 11:02:17,905 DEBUG [RS:0;jenkins-hbase4:34921] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:17,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:17,907 DEBUG [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf 2023-02-14 11:02:17,907 DEBUG [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43675 2023-02-14 11:02:17,907 DEBUG [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:17,908 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39449, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:17,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:17,908 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:17,908 DEBUG [RS:1;jenkins-hbase4:41789] zookeeper.ZKUtil(162): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:17,908 DEBUG [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf 2023-02-14 11:02:17,909 WARN [RS:1;jenkins-hbase4:41789] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:17,909 DEBUG [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43675 2023-02-14 11:02:17,909 INFO [RS:1;jenkins-hbase4:41789] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:17,909 DEBUG [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:17,909 DEBUG [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/WALs/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:17,913 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34921,1676372537582] 2023-02-14 11:02:17,913 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41789,1676372537618] 2023-02-14 11:02:17,913 DEBUG [RS:0;jenkins-hbase4:34921] zookeeper.ZKUtil(162): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:17,913 WARN [RS:0;jenkins-hbase4:34921] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:17,914 INFO [RS:0;jenkins-hbase4:34921] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:17,914 DEBUG [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/WALs/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:17,916 DEBUG [RS:1;jenkins-hbase4:41789] zookeeper.ZKUtil(162): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:17,917 DEBUG [RS:1;jenkins-hbase4:41789] zookeeper.ZKUtil(162): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:17,917 DEBUG [RS:0;jenkins-hbase4:34921] zookeeper.ZKUtil(162): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:17,918 DEBUG [RS:1;jenkins-hbase4:41789] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:17,918 INFO [RS:1;jenkins-hbase4:41789] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:17,918 DEBUG [RS:0;jenkins-hbase4:34921] zookeeper.ZKUtil(162): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:17,919 DEBUG [RS:0;jenkins-hbase4:34921] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:17,919 INFO [RS:0;jenkins-hbase4:34921] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:17,919 INFO [RS:1;jenkins-hbase4:41789] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:17,920 INFO [RS:1;jenkins-hbase4:41789] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:17,920 INFO [RS:1;jenkins-hbase4:41789] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,920 INFO [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:17,921 INFO [RS:0;jenkins-hbase4:34921] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:17,921 INFO [RS:0;jenkins-hbase4:34921] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:17,921 INFO [RS:0;jenkins-hbase4:34921] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,921 INFO [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:17,922 INFO [RS:1;jenkins-hbase4:41789] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,922 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,922 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,922 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,922 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,922 INFO [RS:0;jenkins-hbase4:34921] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,922 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:1;jenkins-hbase4:41789] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,923 DEBUG [RS:0;jenkins-hbase4:34921] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:17,929 INFO [RS:0;jenkins-hbase4:34921] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,929 INFO [RS:1;jenkins-hbase4:41789] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,929 INFO [RS:0;jenkins-hbase4:34921] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,929 INFO [RS:1;jenkins-hbase4:41789] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,930 INFO [RS:0;jenkins-hbase4:34921] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,930 INFO [RS:1;jenkins-hbase4:41789] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,941 INFO [RS:1;jenkins-hbase4:41789] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:17,941 INFO [RS:0;jenkins-hbase4:34921] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:17,941 INFO [RS:1;jenkins-hbase4:41789] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41789,1676372537618-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,941 INFO [RS:0;jenkins-hbase4:34921] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34921,1676372537582-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:17,952 INFO [RS:1;jenkins-hbase4:41789] regionserver.Replication(203): jenkins-hbase4.apache.org,41789,1676372537618 started 2023-02-14 11:02:17,952 INFO [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41789,1676372537618, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41789, sessionid=0x100527eda6b0002 2023-02-14 11:02:17,956 INFO [RS:0;jenkins-hbase4:34921] regionserver.Replication(203): jenkins-hbase4.apache.org,34921,1676372537582 started 2023-02-14 11:02:17,956 DEBUG [RS:1;jenkins-hbase4:41789] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:17,956 DEBUG [RS:1;jenkins-hbase4:41789] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:17,956 DEBUG [RS:1;jenkins-hbase4:41789] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41789,1676372537618' 2023-02-14 11:02:17,956 DEBUG [RS:1;jenkins-hbase4:41789] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:17,956 INFO [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34921,1676372537582, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34921, sessionid=0x100527eda6b0001 2023-02-14 11:02:17,956 DEBUG [RS:0;jenkins-hbase4:34921] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:17,956 DEBUG [RS:0;jenkins-hbase4:34921] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:17,956 DEBUG [RS:0;jenkins-hbase4:34921] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34921,1676372537582' 2023-02-14 11:02:17,956 DEBUG [RS:0;jenkins-hbase4:34921] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:17,956 DEBUG [RS:1;jenkins-hbase4:41789] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:17,956 DEBUG [RS:0;jenkins-hbase4:34921] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:17,957 DEBUG [RS:1;jenkins-hbase4:41789] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:17,957 DEBUG [RS:1;jenkins-hbase4:41789] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:17,957 DEBUG [RS:1;jenkins-hbase4:41789] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:17,957 DEBUG [RS:1;jenkins-hbase4:41789] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41789,1676372537618' 2023-02-14 11:02:17,957 DEBUG [RS:1;jenkins-hbase4:41789] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:17,957 DEBUG [RS:0;jenkins-hbase4:34921] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:17,957 DEBUG [RS:0;jenkins-hbase4:34921] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:17,957 DEBUG [RS:0;jenkins-hbase4:34921] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:17,957 DEBUG [RS:0;jenkins-hbase4:34921] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34921,1676372537582' 2023-02-14 11:02:17,957 DEBUG [RS:0;jenkins-hbase4:34921] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:17,957 DEBUG [RS:1;jenkins-hbase4:41789] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:17,957 DEBUG [RS:0;jenkins-hbase4:34921] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:17,957 DEBUG [RS:1;jenkins-hbase4:41789] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:17,957 INFO [RS:1;jenkins-hbase4:41789] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:17,957 INFO [RS:1;jenkins-hbase4:41789] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:17,957 DEBUG [RS:0;jenkins-hbase4:34921] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:17,958 INFO [RS:0;jenkins-hbase4:34921] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:17,958 INFO [RS:0;jenkins-hbase4:34921] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:17,984 DEBUG [jenkins-hbase4:42293] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-14 11:02:17,984 DEBUG [jenkins-hbase4:42293] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:17,986 DEBUG [jenkins-hbase4:42293] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:17,986 DEBUG [jenkins-hbase4:42293] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:17,986 DEBUG [jenkins-hbase4:42293] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:17,987 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41789,1676372537618, state=OPENING 2023-02-14 11:02:17,988 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-14 11:02:17,989 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:17,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41789,1676372537618}] 2023-02-14 11:02:17,990 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:18,144 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:18,144 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:18,145 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55486, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:18,149 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-14 11:02:18,149 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:18,151 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41789%2C1676372537618.meta, suffix=.meta, logDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/WALs/jenkins-hbase4.apache.org,41789,1676372537618, archiveDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/oldWALs, maxLogs=32 2023-02-14 11:02:18,167 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40865,DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21,DISK] 2023-02-14 11:02:18,167 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38739,DS-9e257492-8f13-4388-b76a-4aca6ff993af,DISK] 2023-02-14 11:02:18,169 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/WALs/jenkins-hbase4.apache.org,41789,1676372537618/jenkins-hbase4.apache.org%2C41789%2C1676372537618.meta.1676372538152.meta 2023-02-14 11:02:18,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40865,DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21,DISK], DatanodeInfoWithStorage[127.0.0.1:38739,DS-9e257492-8f13-4388-b76a-4aca6ff993af,DISK]] 2023-02-14 11:02:18,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:18,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-14 11:02:18,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-14 11:02:18,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-14 11:02:18,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-14 11:02:18,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:18,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-14 11:02:18,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-14 11:02:18,171 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:18,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/info 2023-02-14 11:02:18,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/info 2023-02-14 11:02:18,173 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:18,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:18,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:18,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:18,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:18,174 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:18,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:18,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:18,176 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/table 2023-02-14 11:02:18,176 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/table 2023-02-14 11:02:18,176 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:18,176 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:18,177 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740 2023-02-14 11:02:18,178 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740 2023-02-14 11:02:18,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:18,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:18,181 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73827189, jitterRate=0.10011084377765656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:18,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:18,182 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676372538144 2023-02-14 11:02:18,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-14 11:02:18,186 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-14 11:02:18,188 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41789,1676372537618, state=OPEN 2023-02-14 11:02:18,190 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-14 11:02:18,190 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:18,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-14 11:02:18,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41789,1676372537618 in 200 msec 2023-02-14 11:02:18,193 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-14 11:02:18,193 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-14 11:02:18,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 401 msec 2023-02-14 11:02:18,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676372538194, completionTime=-1 2023-02-14 11:02:18,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-14 11:02:18,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-14 11:02:18,198 DEBUG [hconnection-0x4f7bccb3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:18,199 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55496, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:18,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-14 11:02:18,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676372598201 2023-02-14 11:02:18,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676372658201 2023-02-14 11:02:18,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-14 11:02:18,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42293,1676372537529-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:18,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42293,1676372537529-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:18,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42293,1676372537529-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:18,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42293, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:18,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:18,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-14 11:02:18,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:18,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-14 11:02:18,210 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:18,210 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-14 11:02:18,211 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:18,213 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:18,213 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95 empty. 2023-02-14 11:02:18,214 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:18,214 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-14 11:02:18,227 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:18,228 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 74e1758511c022d7f756ce32911b2b95, NAME => 'hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp 2023-02-14 11:02:18,239 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:18,239 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 74e1758511c022d7f756ce32911b2b95, disabling compactions & flushes 2023-02-14 11:02:18,239 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:18,239 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:18,239 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. after waiting 0 ms 2023-02-14 11:02:18,239 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:18,239 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:18,239 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 74e1758511c022d7f756ce32911b2b95: 2023-02-14 11:02:18,244 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:18,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372538245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372538245"}]},"ts":"1676372538245"} 2023-02-14 11:02:18,247 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:18,248 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:18,248 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372538248"}]},"ts":"1676372538248"} 2023-02-14 11:02:18,249 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-14 11:02:18,257 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:18,258 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:18,258 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:18,258 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:18,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=74e1758511c022d7f756ce32911b2b95, ASSIGN}] 2023-02-14 11:02:18,261 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=74e1758511c022d7f756ce32911b2b95, ASSIGN 2023-02-14 11:02:18,261 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=74e1758511c022d7f756ce32911b2b95, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34921,1676372537582; forceNewPlan=false, retain=false 2023-02-14 11:02:18,412 INFO [jenkins-hbase4:42293] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:18,413 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=74e1758511c022d7f756ce32911b2b95, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:18,413 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372538413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372538413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372538413"}]},"ts":"1676372538413"} 2023-02-14 11:02:18,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 74e1758511c022d7f756ce32911b2b95, server=jenkins-hbase4.apache.org,34921,1676372537582}] 2023-02-14 11:02:18,568 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:18,568 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:18,570 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36574, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:18,574 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:18,576 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34921%2C1676372537582, suffix=, logDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/WALs/jenkins-hbase4.apache.org,34921,1676372537582, archiveDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/oldWALs, maxLogs=32 2023-02-14 11:02:18,591 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40865,DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21,DISK] 2023-02-14 11:02:18,595 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38739,DS-9e257492-8f13-4388-b76a-4aca6ff993af,DISK] 2023-02-14 11:02:18,596 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/WALs/jenkins-hbase4.apache.org,34921,1676372537582/jenkins-hbase4.apache.org%2C34921%2C1676372537582.1676372538576 2023-02-14 11:02:18,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38739,DS-9e257492-8f13-4388-b76a-4aca6ff993af,DISK], DatanodeInfoWithStorage[127.0.0.1:40865,DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21,DISK]] 2023-02-14 11:02:18,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 74e1758511c022d7f756ce32911b2b95, NAME => 'hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:18,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:18,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:18,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:18,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:18,598 INFO [StoreOpener-74e1758511c022d7f756ce32911b2b95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:18,600 DEBUG [StoreOpener-74e1758511c022d7f756ce32911b2b95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95/info 2023-02-14 11:02:18,600 DEBUG [StoreOpener-74e1758511c022d7f756ce32911b2b95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95/info 2023-02-14 11:02:18,600 INFO [StoreOpener-74e1758511c022d7f756ce32911b2b95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74e1758511c022d7f756ce32911b2b95 columnFamilyName info 2023-02-14 11:02:18,601 INFO [StoreOpener-74e1758511c022d7f756ce32911b2b95-1] regionserver.HStore(310): Store=74e1758511c022d7f756ce32911b2b95/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:18,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:18,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:18,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:18,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:18,607 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 74e1758511c022d7f756ce32911b2b95; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64636492, jitterRate=-0.03684121370315552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:18,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 74e1758511c022d7f756ce32911b2b95: 2023-02-14 11:02:18,607 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95., pid=6, masterSystemTime=1676372538568 2023-02-14 11:02:18,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:18,611 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=74e1758511c022d7f756ce32911b2b95, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:18,611 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372538611"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372538611"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372538611"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372538611"}]},"ts":"1676372538611"} 2023-02-14 11:02:18,613 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:18,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-14 11:02:18,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 74e1758511c022d7f756ce32911b2b95, server=jenkins-hbase4.apache.org,34921,1676372537582 in 198 msec 2023-02-14 11:02:18,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-14 11:02:18,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=74e1758511c022d7f756ce32911b2b95, ASSIGN in 357 msec 2023-02-14 11:02:18,617 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:18,617 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372538617"}]},"ts":"1676372538617"} 2023-02-14 11:02:18,619 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-14 11:02:18,621 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:18,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 413 msec 2023-02-14 11:02:18,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-14 11:02:18,711 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:18,711 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:18,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:18,716 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36584, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:18,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-14 11:02:18,725 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:18,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-14 11:02:18,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-14 11:02:18,745 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:18,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-14 11:02:18,753 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-14 11:02:18,755 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-14 11:02:18,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.107sec 2023-02-14 11:02:18,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-14 11:02:18,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-14 11:02:18,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-14 11:02:18,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42293,1676372537529-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-14 11:02:18,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42293,1676372537529-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-14 11:02:18,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-14 11:02:18,842 DEBUG [Listener at localhost/38369] zookeeper.ReadOnlyZKClient(139): Connect 0x3a6963a0 to 127.0.0.1:57254 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:18,847 DEBUG [Listener at localhost/38369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3de96951, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:18,848 DEBUG [hconnection-0x5e2a913c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:18,850 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55510, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:18,852 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:18,852 DEBUG [Listener at localhost/38369] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-14 11:02:18,853 DEBUG [Listener at localhost/38369] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-14 11:02:18,855 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55904, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-14 11:02:18,855 INFO [Listener at localhost/38369] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:18,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:18,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-14 11:02:18,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.14.131:55904 deadline: 1676372598856, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:18,856 INFO [Listener at localhost/38369] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-14 11:02:18,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:18,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:18,861 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:18,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-14 11:02:18,862 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:18,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:18,863 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:18,864 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d empty. 2023-02-14 11:02:18,864 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:18,864 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-14 11:02:18,872 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:18,873 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 05779eabaceb8621a95352dbff13b98d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp 2023-02-14 11:02:18,879 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:18,879 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 05779eabaceb8621a95352dbff13b98d, disabling compactions & flushes 2023-02-14 11:02:18,879 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:18,879 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:18,879 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. after waiting 0 ms 2023-02-14 11:02:18,879 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:18,879 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:18,880 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 05779eabaceb8621a95352dbff13b98d: 2023-02-14 11:02:18,881 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:18,882 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676372538882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372538882"}]},"ts":"1676372538882"} 2023-02-14 11:02:18,884 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:18,884 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:18,885 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372538885"}]},"ts":"1676372538885"} 2023-02-14 11:02:18,886 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-14 11:02:18,889 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:18,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:18,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:18,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:18,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=05779eabaceb8621a95352dbff13b98d, ASSIGN}] 2023-02-14 11:02:18,892 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=05779eabaceb8621a95352dbff13b98d, ASSIGN 2023-02-14 11:02:18,892 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=05779eabaceb8621a95352dbff13b98d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41789,1676372537618; forceNewPlan=false, retain=false 2023-02-14 11:02:18,959 INFO [RS:1;jenkins-hbase4:41789] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41789%2C1676372537618, suffix=, logDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/WALs/jenkins-hbase4.apache.org,41789,1676372537618, archiveDir=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/oldWALs, maxLogs=32 2023-02-14 11:02:18,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:18,974 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40865,DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21,DISK] 2023-02-14 11:02:18,974 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38739,DS-9e257492-8f13-4388-b76a-4aca6ff993af,DISK] 2023-02-14 11:02:18,975 INFO [RS:1;jenkins-hbase4:41789] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/WALs/jenkins-hbase4.apache.org,41789,1676372537618/jenkins-hbase4.apache.org%2C41789%2C1676372537618.1676372538960 2023-02-14 11:02:18,975 DEBUG [RS:1;jenkins-hbase4:41789] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40865,DS-f23a7eeb-c32b-4cd1-9e29-c37167ee0a21,DISK], DatanodeInfoWithStorage[127.0.0.1:38739,DS-9e257492-8f13-4388-b76a-4aca6ff993af,DISK]] 2023-02-14 11:02:19,043 INFO [jenkins-hbase4:42293] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:19,044 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=05779eabaceb8621a95352dbff13b98d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,044 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676372539044"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372539044"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372539044"}]},"ts":"1676372539044"} 2023-02-14 11:02:19,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 05779eabaceb8621a95352dbff13b98d, server=jenkins-hbase4.apache.org,41789,1676372537618}] 2023-02-14 11:02:19,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:19,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:19,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 05779eabaceb8621a95352dbff13b98d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:19,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:19,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:19,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:19,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:19,202 INFO [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:19,204 DEBUG [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1 2023-02-14 11:02:19,204 DEBUG [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1 2023-02-14 11:02:19,204 INFO [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05779eabaceb8621a95352dbff13b98d columnFamilyName f1 2023-02-14 11:02:19,205 INFO [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] regionserver.HStore(310): Store=05779eabaceb8621a95352dbff13b98d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:19,205 INFO [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:19,206 DEBUG [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2 2023-02-14 11:02:19,206 DEBUG [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2 2023-02-14 11:02:19,206 INFO [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05779eabaceb8621a95352dbff13b98d columnFamilyName f2 2023-02-14 11:02:19,206 INFO [StoreOpener-05779eabaceb8621a95352dbff13b98d-1] regionserver.HStore(310): Store=05779eabaceb8621a95352dbff13b98d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:19,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:19,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:19,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:19,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:19,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:19,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 05779eabaceb8621a95352dbff13b98d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73530071, jitterRate=0.09568344056606293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:19,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 05779eabaceb8621a95352dbff13b98d: 2023-02-14 11:02:19,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d., pid=12, masterSystemTime=1676372539197 2023-02-14 11:02:19,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:19,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:19,215 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=05779eabaceb8621a95352dbff13b98d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,215 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676372539215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372539215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372539215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372539215"}]},"ts":"1676372539215"} 2023-02-14 11:02:19,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-14 11:02:19,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 05779eabaceb8621a95352dbff13b98d, server=jenkins-hbase4.apache.org,41789,1676372537618 in 170 msec 2023-02-14 11:02:19,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-14 11:02:19,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=05779eabaceb8621a95352dbff13b98d, ASSIGN in 327 msec 2023-02-14 11:02:19,219 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:19,219 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372539219"}]},"ts":"1676372539219"} 2023-02-14 11:02:19,221 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-14 11:02:19,223 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:19,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 364 msec 2023-02-14 11:02:19,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:19,467 INFO [Listener at localhost/38369] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-14 11:02:19,468 DEBUG [Listener at localhost/38369] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-14 11:02:19,468 INFO [Listener at localhost/38369] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:19,470 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-14 11:02:19,470 INFO [Listener at localhost/38369] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:19,470 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-14 11:02:19,470 INFO [Listener at localhost/38369] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-14 11:02:19,517 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41789] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:19,634 INFO [Listener at localhost/38369] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-14 11:02:19,634 INFO [Listener at localhost/38369] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-14 11:02:19,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-14 11:02:19,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676372539635 (current time:1676372539635). 2023-02-14 11:02:19,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-14 11:02:19,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] zookeeper.ReadOnlyZKClient(139): Connect 0x26be571b to 127.0.0.1:57254 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:19,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e83de23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:19,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:19,643 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55518, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:19,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26be571b to 127.0.0.1:57254 2023-02-14 11:02:19,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:19,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-14 11:02:19,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-14 11:02:19,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-14 11:02:19,648 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-14 11:02:19,649 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676373139649 2023-02-14 11:02:19,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-14 11:02:19,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:19,650 DEBUG [Listener at localhost/38369] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:19,650 DEBUG [Listener at localhost/38369] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-14 11:02:19,651 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-14 11:02:19,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-14 11:02:19,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-14 11:02:19,653 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-14 11:02:19,653 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676373139653 2023-02-14 11:02:19,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-14 11:02:19,668 INFO [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-14 11:02:19,668 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:19,669 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-14 11:02:19,669 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-14 11:02:19,749 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,749 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:19,750 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:19,750 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:19,750 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:19,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:19,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:19,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:19,750 DEBUG [Listener at localhost/38369] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:19,750 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,751 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-14 11:02:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-14 11:02:19,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-14 11:02:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:19,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-14 11:02:19,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-14 11:02:19,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:19,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-14 11:02:19,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-14 11:02:19,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:19,752 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-14 11:02:19,752 DEBUG [Listener at localhost/38369] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-14 11:02:19,756 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-14 11:02:19,756 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-14 11:02:19,756 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-14 11:02:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-14 11:02:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41789,1676372537618' joining acquired barrier for procedure (foo) in zk 2023-02-14 11:02:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-14 11:02:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-14 11:02:19,758 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-14 11:02:19,758 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34921,1676372537582' joining acquired barrier for procedure (foo) in zk 2023-02-14 11:02:19,759 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,759 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:19,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:19,760 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:19,760 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,760 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:19,760 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:19,760 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:19,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:19,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41789,1676372537618' joining acquired barrier for procedure 'foo' on coordinator 2023-02-14 11:02:19,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658aacef[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:19,762 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-14 11:02:19,762 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,764 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,764 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,765 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,764 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-14 11:02:19,765 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:19,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,765 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-14 11:02:19,765 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:02:19,765 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-14 11:02:19,765 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-14 11:02:19,765 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:19,765 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34921,1676372537582' in zk 2023-02-14 11:02:19,765 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. started... 2023-02-14 11:02:19,766 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 05779eabaceb8621a95352dbff13b98d 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-14 11:02:19,767 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-14 11:02:19,767 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:19,767 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-14 11:02:19,783 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/.tmp/f1/b6c2a63a0a17471ba5db4dc947f94158 2023-02-14 11:02:19,803 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/.tmp/f2/75ad25aa58f6456c878d3168d74a8e19 2023-02-14 11:02:19,808 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/.tmp/f1/b6c2a63a0a17471ba5db4dc947f94158 as hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b6c2a63a0a17471ba5db4dc947f94158 2023-02-14 11:02:19,812 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b6c2a63a0a17471ba5db4dc947f94158, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-14 11:02:19,813 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/.tmp/f2/75ad25aa58f6456c878d3168d74a8e19 as hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/75ad25aa58f6456c878d3168d74a8e19 2023-02-14 11:02:19,817 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/75ad25aa58f6456c878d3168d74a8e19, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-14 11:02:19,817 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 05779eabaceb8621a95352dbff13b98d in 51ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:19,817 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-14 11:02:19,818 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 05779eabaceb8621a95352dbff13b98d: 2023-02-14 11:02:19,818 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.' region-info for snapshot=foo 2023-02-14 11:02:19,818 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:19,818 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b6c2a63a0a17471ba5db4dc947f94158] hfiles 2023-02-14 11:02:19,818 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b6c2a63a0a17471ba5db4dc947f94158 for snapshot=foo 2023-02-14 11:02:19,818 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/75ad25aa58f6456c878d3168d74a8e19] hfiles 2023-02-14 11:02:19,818 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/75ad25aa58f6456c878d3168d74a8e19 for snapshot=foo 2023-02-14 11:02:19,824 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. completed. 2023-02-14 11:02:19,824 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:19,824 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-14 11:02:19,824 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-14 11:02:19,824 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,824 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-14 11:02:19,824 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41789,1676372537618' in zk 2023-02-14 11:02:19,826 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-14 11:02:19,826 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,826 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:19,826 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-14 11:02:19,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:19,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:19,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,41789,1676372537618': 2023-02-14 11:02:19,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41789,1676372537618' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-14 11:02:19,830 INFO [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-14 11:02:19,830 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:19,830 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:19,830 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-14 11:02:19,830 INFO [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-14 11:02:19,832 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,832 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,832 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,832 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:19,832 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:19,832 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:19,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:19,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,833 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:19,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:19,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,839 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:19,839 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,849 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,849 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:19,849 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:19,849 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:19,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:19,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:19,849 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:19,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-14 11:02:19,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:19,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-14 11:02:19,849 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:19,849 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:19,849 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:19,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:19,849 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:19,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:19,850 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:19,851 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,851 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:19,851 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-14 11:02:19,851 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-14 11:02:19,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.hbase-snapshot/.tmp/foo 2023-02-14 11:02:19,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:19,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.hbase-snapshot/.tmp/foo to hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.hbase-snapshot/foo 2023-02-14 11:02:19,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-14 11:02:19,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.hbase-snapshot/.tmp/foo 2023-02-14 11:02:19,893 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.hbase-snapshot/.tmp/foo 2023-02-14 11:02:19,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676372539649Consolidate snapshot: foo at 1676372539849 (+200 ms)Loading Region manifests for foo at 1676372539849Writing data manifest for foo at 1676372539855 (+6 ms)Verifying snapshot: foo at 1676372539862 (+7 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676372539893 (+31 ms) 2023-02-14 11:02:19,895 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-14 11:02:19,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 245 msec 2023-02-14 11:02:19,952 DEBUG [Listener at localhost/38369] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:19,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-14 11:02:19,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-14 11:02:19,954 INFO [Listener at localhost/38369] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-14 11:02:19,958 INFO [Listener at localhost/38369] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-14 11:02:19,963 INFO [Listener at localhost/38369] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-14 11:02:20,012 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41789] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,104 INFO [Listener at localhost/38369] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-14 11:02:20,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-14 11:02:20,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,113 INFO [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-14 11:02:20,113 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:20,113 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-14 11:02:20,114 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-14 11:02:20,114 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,114 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,115 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:20,115 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:20,115 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:20,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:20,116 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,116 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:20,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,117 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:20,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,117 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,118 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-14 11:02:20,118 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:20,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,118 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-14 11:02:20,118 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-14 11:02:20,118 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34921,1676372537582' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-14 11:02:20,118 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-14 11:02:20,118 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:20,119 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-14 11:02:20,119 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-14 11:02:20,119 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:20,120 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,120 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. started... 2023-02-14 11:02:20,120 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 05779eabaceb8621a95352dbff13b98d 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-14 11:02:20,120 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,121 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,121 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:20,138 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/.tmp/f1/b2dd0fab57e94a749d8781f8e82e1e77 2023-02-14 11:02:20,159 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/.tmp/f2/26baaceb31f24c12b6e865a8cd71dfc2 2023-02-14 11:02:20,164 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/.tmp/f1/b2dd0fab57e94a749d8781f8e82e1e77 as hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b2dd0fab57e94a749d8781f8e82e1e77 2023-02-14 11:02:20,168 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b2dd0fab57e94a749d8781f8e82e1e77, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-14 11:02:20,169 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/.tmp/f2/26baaceb31f24c12b6e865a8cd71dfc2 as hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/26baaceb31f24c12b6e865a8cd71dfc2 2023-02-14 11:02:20,173 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/26baaceb31f24c12b6e865a8cd71dfc2, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-14 11:02:20,174 INFO [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 05779eabaceb8621a95352dbff13b98d in 54ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:20,175 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 05779eabaceb8621a95352dbff13b98d: 2023-02-14 11:02:20,175 DEBUG [rs(jenkins-hbase4.apache.org,41789,1676372537618)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,175 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-14 11:02:20,175 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-14 11:02:20,175 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,175 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-14 11:02:20,175 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41789,1676372537618' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-14 11:02:20,177 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,177 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:20,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:20,178 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:20,178 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:20,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:20,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:20,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41789,1676372537618' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-14 11:02:20,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61b52486[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:20,179 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-14 11:02:20,179 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,181 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,181 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,181 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-14 11:02:20,181 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-14 11:02:20,181 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,181 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:20,181 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,41789,1676372537618' in zk 2023-02-14 11:02:20,181 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-14 11:02:20,181 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-14 11:02:20,181 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,34921,1676372537582' in zk 2023-02-14 11:02:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-14 11:02:20,183 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:20,183 DEBUG [member: 'jenkins-hbase4.apache.org,34921,1676372537582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-14 11:02:20,184 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-14 11:02:20,184 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,184 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:20,184 DEBUG [member: 'jenkins-hbase4.apache.org,41789,1676372537618' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-14 11:02:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:20,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:20,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,41789,1676372537618': 2023-02-14 11:02:20,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41789,1676372537618' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-14 11:02:20,187 INFO [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-14 11:02:20,188 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:20,188 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:20,188 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,188 INFO [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-14 11:02:20,190 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,190 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,190 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,190 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:20,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:20,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:20,190 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:20,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:20,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:20,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:20,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:20,191 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:20,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,192 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:20,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,193 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:20,193 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,195 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:20,196 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:20,196 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,196 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:20,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:20,196 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:20,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-14 11:02:20,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-14 11:02:20,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:20,196 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:20,196 DEBUG [(jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:20,196 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,197 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,197 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,197 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,197 DEBUG [Listener at localhost/38369] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:20,197 DEBUG [Listener at localhost/38369] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-14 11:02:20,197 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,197 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,197 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:20,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:20,297 DEBUG [Listener at localhost/38369] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-14 11:02:20,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-14 11:02:20,303 INFO [Listener at localhost/38369] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676372539635 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:20,303 DEBUG [Listener at localhost/38369] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43675/user/jenkins/test-data/99e76430-574a-7710-c3b0-7faadb1b63de/foo/b287f488-ada1-432e-b3a5-06ed0464a964/data/default/testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,304 INFO [Listener at localhost/38369] snapshot.RestoreSnapshotHelper(239): region to add: 05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:20,304 INFO [Listener at localhost/38369] snapshot.RestoreSnapshotHelper(585): clone region=05779eabaceb8621a95352dbff13b98d as 05779eabaceb8621a95352dbff13b98d in snapshot foo 2023-02-14 11:02:20,305 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 05779eabaceb8621a95352dbff13b98d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43675/user/jenkins/test-data/99e76430-574a-7710-c3b0-7faadb1b63de/foo/b287f488-ada1-432e-b3a5-06ed0464a964 2023-02-14 11:02:20,311 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:20,311 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b6c2a63a0a17471ba5db4dc947f94158 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,314 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 75ad25aa58f6456c878d3168d74a8e19 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,316 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 05779eabaceb8621a95352dbff13b98d, disabling compactions & flushes 2023-02-14 11:02:20,316 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,316 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,316 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. after waiting 0 ms 2023-02-14 11:02:20,316 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,316 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,316 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 05779eabaceb8621a95352dbff13b98d: 2023-02-14 11:02:20,316 INFO [Listener at localhost/38369] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676372539635 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:20,316 DEBUG [Listener at localhost/38369] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43675/user/jenkins/test-data/99e76430-574a-7710-c3b0-7faadb1b63de/foo/b287f488-ada1-432e-b3a5-06ed0464a964 2023-02-14 11:02:20,316 DEBUG [Listener at localhost/38369] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43675/user/jenkins/test-data/99e76430-574a-7710-c3b0-7faadb1b63de/foo/b287f488-ada1-432e-b3a5-06ed0464a964 2023-02-14 11:02:20,317 DEBUG [Listener at localhost/38369] util.CommonFSUtils(699): |-data/ 2023-02-14 11:02:20,317 DEBUG [Listener at localhost/38369] util.CommonFSUtils(699): |----default/ 2023-02-14 11:02:20,318 DEBUG [Listener at localhost/38369] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-14 11:02:20,318 DEBUG [Listener at localhost/38369] util.CommonFSUtils(699): |----------05779eabaceb8621a95352dbff13b98d/ 2023-02-14 11:02:20,318 DEBUG [Listener at localhost/38369] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:20,318 DEBUG [Listener at localhost/38369] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:20,319 DEBUG [Listener at localhost/38369] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=05779eabaceb8621a95352dbff13b98d-b6c2a63a0a17471ba5db4dc947f94158 2023-02-14 11:02:20,319 DEBUG [Listener at localhost/38369] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:20,319 DEBUG [Listener at localhost/38369] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=05779eabaceb8621a95352dbff13b98d-75ad25aa58f6456c878d3168d74a8e19 2023-02-14 11:02:20,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-14 11:02:20,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-14 11:02:20,323 INFO [Listener at localhost/38369] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:20,327 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372540327"}]},"ts":"1676372540327"} 2023-02-14 11:02:20,328 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-14 11:02:20,330 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-14 11:02:20,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=05779eabaceb8621a95352dbff13b98d, UNASSIGN}] 2023-02-14 11:02:20,332 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=05779eabaceb8621a95352dbff13b98d, UNASSIGN 2023-02-14 11:02:20,333 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=05779eabaceb8621a95352dbff13b98d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,333 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676372540333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372540333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372540333"}]},"ts":"1676372540333"} 2023-02-14 11:02:20,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 05779eabaceb8621a95352dbff13b98d, server=jenkins-hbase4.apache.org,41789,1676372537618}] 2023-02-14 11:02:20,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:20,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:20,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 05779eabaceb8621a95352dbff13b98d, disabling compactions & flushes 2023-02-14 11:02:20,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. after waiting 0 ms 2023-02-14 11:02:20,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:20,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d. 2023-02-14 11:02:20,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 05779eabaceb8621a95352dbff13b98d: 2023-02-14 11:02:20,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:20,493 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=05779eabaceb8621a95352dbff13b98d, regionState=CLOSED 2023-02-14 11:02:20,493 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676372540493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372540493"}]},"ts":"1676372540493"} 2023-02-14 11:02:20,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-14 11:02:20,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 05779eabaceb8621a95352dbff13b98d, server=jenkins-hbase4.apache.org,41789,1676372537618 in 160 msec 2023-02-14 11:02:20,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-14 11:02:20,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=05779eabaceb8621a95352dbff13b98d, UNASSIGN in 164 msec 2023-02-14 11:02:20,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372540497"}]},"ts":"1676372540497"} 2023-02-14 11:02:20,498 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-14 11:02:20,500 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-14 11:02:20,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 176 msec 2023-02-14 11:02:20,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:20,631 INFO [Listener at localhost/38369] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-14 11:02:20,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,634 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,634 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-14 11:02:20,638 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:20,640 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1, FileablePath, hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2, FileablePath, hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/recovered.edits] 2023-02-14 11:02:20,643 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b2dd0fab57e94a749d8781f8e82e1e77 to hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/archive/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b2dd0fab57e94a749d8781f8e82e1e77 2023-02-14 11:02:20,644 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b6c2a63a0a17471ba5db4dc947f94158 to hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/archive/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f1/b6c2a63a0a17471ba5db4dc947f94158 2023-02-14 11:02:20,647 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/26baaceb31f24c12b6e865a8cd71dfc2 to hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/archive/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/26baaceb31f24c12b6e865a8cd71dfc2 2023-02-14 11:02:20,648 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/75ad25aa58f6456c878d3168d74a8e19 to hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/archive/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/f2/75ad25aa58f6456c878d3168d74a8e19 2023-02-14 11:02:20,651 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/recovered.edits/12.seqid to hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/archive/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d/recovered.edits/12.seqid 2023-02-14 11:02:20,651 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/.tmp/data/default/testInitTableSnapshotMapperJobConfig/05779eabaceb8621a95352dbff13b98d 2023-02-14 11:02:20,651 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-14 11:02:20,653 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,655 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-14 11:02:20,657 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-14 11:02:20,660 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,660 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-14 11:02:20,660 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372540660"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:20,662 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-14 11:02:20,662 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 05779eabaceb8621a95352dbff13b98d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676372538858.05779eabaceb8621a95352dbff13b98d.', STARTKEY => '', ENDKEY => ''}] 2023-02-14 11:02:20,662 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-14 11:02:20,662 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676372540662"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:20,663 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-14 11:02:20,666 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-14 11:02:20,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 34 msec 2023-02-14 11:02:20,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-14 11:02:20,737 INFO [Listener at localhost/38369] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-14 11:02:20,737 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-14 11:02:20,737 INFO [Listener at localhost/38369] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-14 11:02:20,737 DEBUG [Listener at localhost/38369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a6963a0 to 127.0.0.1:57254 2023-02-14 11:02:20,737 DEBUG [Listener at localhost/38369] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:20,737 DEBUG [Listener at localhost/38369] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-14 11:02:20,737 DEBUG [Listener at localhost/38369] util.JVMClusterUtil(257): Found active master hash=413189216, stopped=false 2023-02-14 11:02:20,738 INFO [Listener at localhost/38369] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:20,739 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:20,739 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:20,739 INFO [Listener at localhost/38369] procedure2.ProcedureExecutor(629): Stopping 2023-02-14 11:02:20,739 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:20,739 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:20,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:20,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:20,742 DEBUG [Listener at localhost/38369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e73fbdb to 127.0.0.1:57254 2023-02-14 11:02:20,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:20,742 DEBUG [Listener at localhost/38369] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:20,743 INFO [Listener at localhost/38369] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34921,1676372537582' ***** 2023-02-14 11:02:20,743 INFO [Listener at localhost/38369] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:20,743 INFO [Listener at localhost/38369] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41789,1676372537618' ***** 2023-02-14 11:02:20,743 INFO [Listener at localhost/38369] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:20,743 INFO [RS:0;jenkins-hbase4:34921] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:20,743 INFO [RS:0;jenkins-hbase4:34921] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:20,743 INFO [RS:0;jenkins-hbase4:34921] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:20,743 INFO [RS:1;jenkins-hbase4:41789] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:20,743 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:20,743 INFO [RS:1;jenkins-hbase4:41789] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:20,743 INFO [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(3304): Received CLOSE for 74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:20,744 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:20,744 INFO [RS:1;jenkins-hbase4:41789] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:20,748 INFO [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,748 INFO [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,748 DEBUG [RS:0;jenkins-hbase4:34921] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x541ba805 to 127.0.0.1:57254 2023-02-14 11:02:20,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 74e1758511c022d7f756ce32911b2b95, disabling compactions & flushes 2023-02-14 11:02:20,748 DEBUG [RS:1;jenkins-hbase4:41789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c4bfeb3 to 127.0.0.1:57254 2023-02-14 11:02:20,749 DEBUG [RS:1;jenkins-hbase4:41789] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:20,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:20,749 DEBUG [RS:0;jenkins-hbase4:34921] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:20,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:20,749 INFO [RS:1;jenkins-hbase4:41789] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:20,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. after waiting 0 ms 2023-02-14 11:02:20,749 INFO [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-14 11:02:20,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:20,750 INFO [RS:1;jenkins-hbase4:41789] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:20,750 INFO [RS:1;jenkins-hbase4:41789] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:20,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 74e1758511c022d7f756ce32911b2b95 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-14 11:02:20,750 DEBUG [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1479): Online Regions={74e1758511c022d7f756ce32911b2b95=hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95.} 2023-02-14 11:02:20,750 INFO [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-14 11:02:20,750 DEBUG [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1505): Waiting on 74e1758511c022d7f756ce32911b2b95 2023-02-14 11:02:20,750 INFO [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-14 11:02:20,750 DEBUG [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-14 11:02:20,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:20,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:20,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:20,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:20,751 DEBUG [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-14 11:02:20,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:20,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-14 11:02:20,772 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/.tmp/info/f18ab37ba1cc473e9be6670f6ec6eff8 2023-02-14 11:02:20,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95/.tmp/info/be3592f7111542ba8fd2942837845bd7 2023-02-14 11:02:20,777 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f18ab37ba1cc473e9be6670f6ec6eff8 2023-02-14 11:02:20,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95/.tmp/info/be3592f7111542ba8fd2942837845bd7 as hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95/info/be3592f7111542ba8fd2942837845bd7 2023-02-14 11:02:20,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95/info/be3592f7111542ba8fd2942837845bd7, entries=2, sequenceid=6, filesize=4.8 K 2023-02-14 11:02:20,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 74e1758511c022d7f756ce32911b2b95 in 34ms, sequenceid=6, compaction requested=false 2023-02-14 11:02:20,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/namespace/74e1758511c022d7f756ce32911b2b95/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-14 11:02:20,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:20,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 74e1758511c022d7f756ce32911b2b95: 2023-02-14 11:02:20,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676372538208.74e1758511c022d7f756ce32911b2b95. 2023-02-14 11:02:20,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/.tmp/rep_barrier/f8b0666ec5f5468399caa0112cb67051 2023-02-14 11:02:20,793 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8b0666ec5f5468399caa0112cb67051 2023-02-14 11:02:20,800 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/.tmp/table/a35acc6e574a44a595df79c6c046ff19 2023-02-14 11:02:20,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a35acc6e574a44a595df79c6c046ff19 2023-02-14 11:02:20,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/.tmp/info/f18ab37ba1cc473e9be6670f6ec6eff8 as hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/info/f18ab37ba1cc473e9be6670f6ec6eff8 2023-02-14 11:02:20,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f18ab37ba1cc473e9be6670f6ec6eff8 2023-02-14 11:02:20,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/info/f18ab37ba1cc473e9be6670f6ec6eff8, entries=12, sequenceid=21, filesize=6.3 K 2023-02-14 11:02:20,808 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/.tmp/rep_barrier/f8b0666ec5f5468399caa0112cb67051 as hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/rep_barrier/f8b0666ec5f5468399caa0112cb67051 2023-02-14 11:02:20,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8b0666ec5f5468399caa0112cb67051 2023-02-14 11:02:20,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/rep_barrier/f8b0666ec5f5468399caa0112cb67051, entries=1, sequenceid=21, filesize=5.0 K 2023-02-14 11:02:20,813 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/.tmp/table/a35acc6e574a44a595df79c6c046ff19 as hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/table/a35acc6e574a44a595df79c6c046ff19 2023-02-14 11:02:20,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a35acc6e574a44a595df79c6c046ff19 2023-02-14 11:02:20,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/table/a35acc6e574a44a595df79c6c046ff19, entries=4, sequenceid=21, filesize=5.1 K 2023-02-14 11:02:20,818 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 67ms, sequenceid=21, compaction requested=false 2023-02-14 11:02:20,821 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-14 11:02:20,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:20,822 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:20,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:20,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:20,832 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:20,832 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:20,929 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-14 11:02:20,930 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-14 11:02:20,950 INFO [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34921,1676372537582; all regions closed. 2023-02-14 11:02:20,951 INFO [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41789,1676372537618; all regions closed. 2023-02-14 11:02:20,957 DEBUG [RS:0;jenkins-hbase4:34921] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/oldWALs 2023-02-14 11:02:20,957 INFO [RS:0;jenkins-hbase4:34921] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34921%2C1676372537582:(num 1676372538576) 2023-02-14 11:02:20,957 DEBUG [RS:0;jenkins-hbase4:34921] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:20,957 INFO [RS:0;jenkins-hbase4:34921] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:20,957 INFO [RS:0;jenkins-hbase4:34921] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:20,957 INFO [RS:0;jenkins-hbase4:34921] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:20,957 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:20,957 DEBUG [RS:1;jenkins-hbase4:41789] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/oldWALs 2023-02-14 11:02:20,957 INFO [RS:0;jenkins-hbase4:34921] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:20,958 INFO [RS:1;jenkins-hbase4:41789] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41789%2C1676372537618.meta:.meta(num 1676372538152) 2023-02-14 11:02:20,958 INFO [RS:0;jenkins-hbase4:34921] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:20,959 INFO [RS:0;jenkins-hbase4:34921] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34921 2023-02-14 11:02:20,960 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,960 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:20,960 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34921,1676372537582 2023-02-14 11:02:20,961 ERROR [Listener at localhost/38369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d12b39f rejected from java.util.concurrent.ThreadPoolExecutor@692d3ae5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:20,961 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:20,961 ERROR [Listener at localhost/38369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@653f1c4d rejected from java.util.concurrent.ThreadPoolExecutor@692d3ae5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:20,960 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:20,962 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34921,1676372537582] 2023-02-14 11:02:20,962 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34921,1676372537582; numProcessing=1 2023-02-14 11:02:20,964 DEBUG [RS:1;jenkins-hbase4:41789] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/oldWALs 2023-02-14 11:02:20,964 INFO [RS:1;jenkins-hbase4:41789] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41789%2C1676372537618:(num 1676372538960) 2023-02-14 11:02:20,964 DEBUG [RS:1;jenkins-hbase4:41789] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:20,964 INFO [RS:1;jenkins-hbase4:41789] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:20,964 INFO [RS:1;jenkins-hbase4:41789] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:20,964 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:20,965 INFO [RS:1;jenkins-hbase4:41789] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41789 2023-02-14 11:02:20,965 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34921,1676372537582 already deleted, retry=false 2023-02-14 11:02:20,965 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34921,1676372537582 expired; onlineServers=1 2023-02-14 11:02:20,966 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:20,966 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41789,1676372537618 2023-02-14 11:02:20,966 ERROR [Listener at localhost/38369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@579cc8ee rejected from java.util.concurrent.ThreadPoolExecutor@53a356c5[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:20,967 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41789,1676372537618] 2023-02-14 11:02:20,967 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41789,1676372537618; numProcessing=2 2023-02-14 11:02:20,968 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41789,1676372537618 already deleted, retry=false 2023-02-14 11:02:20,968 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41789,1676372537618 expired; onlineServers=0 2023-02-14 11:02:20,968 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42293,1676372537529' ***** 2023-02-14 11:02:20,968 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-14 11:02:20,969 DEBUG [M:0;jenkins-hbase4:42293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c9f53ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:20,969 INFO [M:0;jenkins-hbase4:42293] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42293,1676372537529 2023-02-14 11:02:20,969 INFO [M:0;jenkins-hbase4:42293] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42293,1676372537529; all regions closed. 2023-02-14 11:02:20,969 DEBUG [M:0;jenkins-hbase4:42293] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:20,969 DEBUG [M:0;jenkins-hbase4:42293] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-14 11:02:20,969 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-14 11:02:20,969 DEBUG [M:0;jenkins-hbase4:42293] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-14 11:02:20,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372537798] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372537798,5,FailOnTimeoutGroup] 2023-02-14 11:02:20,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372537798] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372537798,5,FailOnTimeoutGroup] 2023-02-14 11:02:20,970 INFO [M:0;jenkins-hbase4:42293] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-14 11:02:20,971 INFO [M:0;jenkins-hbase4:42293] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-14 11:02:20,971 INFO [M:0;jenkins-hbase4:42293] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-14 11:02:20,971 DEBUG [M:0;jenkins-hbase4:42293] master.HMaster(1512): Stopping service threads 2023-02-14 11:02:20,971 INFO [M:0;jenkins-hbase4:42293] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-14 11:02:20,972 ERROR [M:0;jenkins-hbase4:42293] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-14 11:02:20,972 INFO [M:0;jenkins-hbase4:42293] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-14 11:02:20,972 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-14 11:02:20,975 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:20,975 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:20,975 DEBUG [M:0;jenkins-hbase4:42293] zookeeper.ZKUtil(398): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-14 11:02:20,975 WARN [M:0;jenkins-hbase4:42293] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-14 11:02:20,975 INFO [M:0;jenkins-hbase4:42293] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-14 11:02:20,976 INFO [M:0;jenkins-hbase4:42293] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-14 11:02:20,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:20,977 DEBUG [M:0;jenkins-hbase4:42293] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:20,977 INFO [M:0;jenkins-hbase4:42293] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:20,977 DEBUG [M:0;jenkins-hbase4:42293] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:20,977 DEBUG [M:0;jenkins-hbase4:42293] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:20,977 DEBUG [M:0;jenkins-hbase4:42293] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:20,977 INFO [M:0;jenkins-hbase4:42293] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.92 KB heapSize=66.88 KB 2023-02-14 11:02:20,985 INFO [M:0;jenkins-hbase4:42293] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.92 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/eeb258ca91d64be1bdc35acdb7545d5c 2023-02-14 11:02:20,989 DEBUG [M:0;jenkins-hbase4:42293] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/eeb258ca91d64be1bdc35acdb7545d5c as hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/eeb258ca91d64be1bdc35acdb7545d5c 2023-02-14 11:02:20,993 INFO [M:0;jenkins-hbase4:42293] regionserver.HStore(1080): Added hdfs://localhost:43675/user/jenkins/test-data/0b50bee6-0b98-72d2-f8fd-731d3fee96cf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/eeb258ca91d64be1bdc35acdb7545d5c, entries=17, sequenceid=132, filesize=8.7 K 2023-02-14 11:02:20,995 INFO [M:0;jenkins-hbase4:42293] regionserver.HRegion(2947): Finished flush of dataSize ~55.92 KB/57260, heapSize ~66.86 KB/68464, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-14 11:02:20,995 INFO [M:0;jenkins-hbase4:42293] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:20,995 DEBUG [M:0;jenkins-hbase4:42293] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:20,998 INFO [M:0;jenkins-hbase4:42293] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-14 11:02:20,998 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:20,999 INFO [M:0;jenkins-hbase4:42293] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42293 2023-02-14 11:02:21,000 DEBUG [M:0;jenkins-hbase4:42293] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42293,1676372537529 already deleted, retry=false 2023-02-14 11:02:21,177 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:21,241 INFO [M:0;jenkins-hbase4:42293] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42293,1676372537529; zookeeper connection closed. 2023-02-14 11:02:21,241 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:21,241 ERROR [Listener at localhost/38369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14136d5b rejected from java.util.concurrent.ThreadPoolExecutor@102cfb01[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:21,243 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): master:42293-0x100527eda6b0000, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:21,243 ERROR [Listener at localhost/38369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6bc732ac rejected from java.util.concurrent.ThreadPoolExecutor@102cfb01[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:21,341 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:21,341 INFO [RS:1;jenkins-hbase4:41789] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41789,1676372537618; zookeeper connection closed. 2023-02-14 11:02:21,341 ERROR [Listener at localhost/38369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1697f321 rejected from java.util.concurrent.ThreadPoolExecutor@53a356c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:21,341 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:41789-0x100527eda6b0002, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:21,341 ERROR [Listener at localhost/38369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6ea1fdf1 rejected from java.util.concurrent.ThreadPoolExecutor@53a356c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:21,341 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@45135c20] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@45135c20 2023-02-14 11:02:21,441 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:21,441 INFO [RS:0;jenkins-hbase4:34921] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34921,1676372537582; zookeeper connection closed. 2023-02-14 11:02:21,441 ERROR [Listener at localhost/38369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1db32e60 rejected from java.util.concurrent.ThreadPoolExecutor@692d3ae5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:21,441 DEBUG [Listener at localhost/38369-EventThread] zookeeper.ZKWatcher(600): regionserver:34921-0x100527eda6b0001, quorum=127.0.0.1:57254, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:21,441 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4ef1a208] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4ef1a208 2023-02-14 11:02:21,441 ERROR [Listener at localhost/38369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5140f652 rejected from java.util.concurrent.ThreadPoolExecutor@692d3ae5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:21,441 INFO [Listener at localhost/38369] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-14 11:02:21,442 WARN [Listener at localhost/38369] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:21,447 INFO [Listener at localhost/38369] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:21,551 WARN [BP-1737362688-172.31.14.131-1676372536687 heartbeating to localhost/127.0.0.1:43675] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:21,551 WARN [BP-1737362688-172.31.14.131-1676372536687 heartbeating to localhost/127.0.0.1:43675] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1737362688-172.31.14.131-1676372536687 (Datanode Uuid 9c685bb6-c66c-49f4-976f-65fb5c89cdd8) service to localhost/127.0.0.1:43675 2023-02-14 11:02:21,552 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/cluster_75ebddf1-5c55-b195-4320-3c9e48205cbf/dfs/data/data3/current/BP-1737362688-172.31.14.131-1676372536687] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:21,552 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/cluster_75ebddf1-5c55-b195-4320-3c9e48205cbf/dfs/data/data4/current/BP-1737362688-172.31.14.131-1676372536687] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:21,554 WARN [Listener at localhost/38369] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:21,557 INFO [Listener at localhost/38369] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:21,661 WARN [BP-1737362688-172.31.14.131-1676372536687 heartbeating to localhost/127.0.0.1:43675] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:21,662 WARN [BP-1737362688-172.31.14.131-1676372536687 heartbeating to localhost/127.0.0.1:43675] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1737362688-172.31.14.131-1676372536687 (Datanode Uuid 007459e0-5632-4c92-9ca6-faf2d132ed2b) service to localhost/127.0.0.1:43675 2023-02-14 11:02:21,662 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/cluster_75ebddf1-5c55-b195-4320-3c9e48205cbf/dfs/data/data1/current/BP-1737362688-172.31.14.131-1676372536687] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:21,663 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/cluster_75ebddf1-5c55-b195-4320-3c9e48205cbf/dfs/data/data2/current/BP-1737362688-172.31.14.131-1676372536687] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:21,673 INFO [Listener at localhost/38369] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:21,787 INFO [Listener at localhost/38369] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-14 11:02:21,803 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-14 11:02:21,815 INFO [Listener at localhost/38369] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=179 (was 155) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43675 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:43675 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/38369 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:43675 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:43675 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:43675 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:43675 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42293,1676372537529)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:43675 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=574 (was 542) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 298), ProcessCount=168 (was 168), AvailableMemoryMB=5695 (was 5811) 2023-02-14 11:02:21,825 INFO [Listener at localhost/38369] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=179, OpenFileDescriptor=574, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=168, AvailableMemoryMB=5694 2023-02-14 11:02:21,835 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/hadoop.log.dir so I do NOT create it in target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06 2023-02-14 11:02:21,835 WARN [Listener at localhost/38369] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/hadoop.log.dir Erasing configuration value by system value. 2023-02-14 11:02:21,835 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/hadoop.tmp.dir so I do NOT create it in target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06 2023-02-14 11:02:21,835 WARN [Listener at localhost/38369] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/258fa1c3-e6b5-7d41-58e7-703a6ab3788e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-14 11:02:21,835 DEBUG [Listener at localhost/38369] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06 2023-02-14 11:02:21,835 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-14 11:02:21,835 INFO [Listener at localhost/38369] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/cluster_57d695fe-4bf7-42f8-8792-2ab6772df055, deleteOnExit=true 2023-02-14 11:02:21,835 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-14 11:02:21,836 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/test.cache.data in system properties and HBase conf 2023-02-14 11:02:21,836 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/hadoop.tmp.dir in system properties and HBase conf 2023-02-14 11:02:21,836 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/hadoop.log.dir in system properties and HBase conf 2023-02-14 11:02:21,836 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-14 11:02:21,836 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-14 11:02:21,836 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-14 11:02:21,836 DEBUG [Listener at localhost/38369] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-14 11:02:21,836 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:21,836 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:21,836 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/nfs.dump.dir in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/java.io.tmpdir in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-14 11:02:21,837 INFO [Listener at localhost/38369] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-14 11:02:21,841 WARN [Listener at localhost/38369] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:21,841 WARN [Listener at localhost/38369] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:21,880 WARN [Listener at localhost/38369] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:21,883 INFO [Listener at localhost/38369] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:21,892 INFO [Listener at localhost/38369] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/java.io.tmpdir/Jetty_localhost_34303_hdfs____l6d6hr/webapp 2023-02-14 11:02:21,990 INFO [Listener at localhost/38369] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34303 2023-02-14 11:02:21,994 WARN [Listener at localhost/38369] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:21,994 WARN [Listener at localhost/38369] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:22,039 WARN [Listener at localhost/39115] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:22,050 WARN [Listener at localhost/39115] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:22,052 WARN [Listener at localhost/39115] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:22,054 INFO [Listener at localhost/39115] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:22,061 INFO [Listener at localhost/39115] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/java.io.tmpdir/Jetty_localhost_35379_datanode____.7tufvq/webapp 2023-02-14 11:02:22,154 INFO [Listener at localhost/39115] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35379 2023-02-14 11:02:22,161 WARN [Listener at localhost/38717] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:22,178 WARN [Listener at localhost/38717] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:22,180 WARN [Listener at localhost/38717] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:22,181 INFO [Listener at localhost/38717] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:22,184 INFO [Listener at localhost/38717] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/java.io.tmpdir/Jetty_localhost_42695_datanode____.op1u9x/webapp 2023-02-14 11:02:22,265 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd42f91bd66dabd7: Processing first storage report for DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4 from datanode fe75f8d3-ffb8-45f5-99a3-bcc5600df4e7 2023-02-14 11:02:22,266 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd42f91bd66dabd7: from storage DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4 node DatanodeRegistration(127.0.0.1:46275, datanodeUuid=fe75f8d3-ffb8-45f5-99a3-bcc5600df4e7, infoPort=33965, infoSecurePort=0, ipcPort=38717, storageInfo=lv=-57;cid=testClusterID;nsid=1347114560;c=1676372541844), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-14 11:02:22,266 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd42f91bd66dabd7: Processing first storage report for DS-f70c279c-c15c-4da3-b910-9a0249cf54b6 from datanode fe75f8d3-ffb8-45f5-99a3-bcc5600df4e7 2023-02-14 11:02:22,266 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd42f91bd66dabd7: from storage DS-f70c279c-c15c-4da3-b910-9a0249cf54b6 node DatanodeRegistration(127.0.0.1:46275, datanodeUuid=fe75f8d3-ffb8-45f5-99a3-bcc5600df4e7, infoPort=33965, infoSecurePort=0, ipcPort=38717, storageInfo=lv=-57;cid=testClusterID;nsid=1347114560;c=1676372541844), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:22,281 INFO [Listener at localhost/38717] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42695 2023-02-14 11:02:22,289 WARN [Listener at localhost/38713] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:22,392 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x22b62fd51a3e457: Processing first storage report for DS-f361960d-df09-431b-b43e-cb11522844fb from datanode 2f14324a-f27a-4bdd-9c9a-b17b3a62ea77 2023-02-14 11:02:22,392 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x22b62fd51a3e457: from storage DS-f361960d-df09-431b-b43e-cb11522844fb node DatanodeRegistration(127.0.0.1:37247, datanodeUuid=2f14324a-f27a-4bdd-9c9a-b17b3a62ea77, infoPort=38899, infoSecurePort=0, ipcPort=38713, storageInfo=lv=-57;cid=testClusterID;nsid=1347114560;c=1676372541844), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:22,392 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x22b62fd51a3e457: Processing first storage report for DS-3592647c-1826-4055-a06d-4a18bc94ec92 from datanode 2f14324a-f27a-4bdd-9c9a-b17b3a62ea77 2023-02-14 11:02:22,392 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x22b62fd51a3e457: from storage DS-3592647c-1826-4055-a06d-4a18bc94ec92 node DatanodeRegistration(127.0.0.1:37247, datanodeUuid=2f14324a-f27a-4bdd-9c9a-b17b3a62ea77, infoPort=38899, infoSecurePort=0, ipcPort=38713, storageInfo=lv=-57;cid=testClusterID;nsid=1347114560;c=1676372541844), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:22,398 DEBUG [Listener at localhost/38713] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06 2023-02-14 11:02:22,401 INFO [Listener at localhost/38713] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/cluster_57d695fe-4bf7-42f8-8792-2ab6772df055/zookeeper_0, clientPort=60887, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/cluster_57d695fe-4bf7-42f8-8792-2ab6772df055/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/cluster_57d695fe-4bf7-42f8-8792-2ab6772df055/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-14 11:02:22,402 INFO [Listener at localhost/38713] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60887 2023-02-14 11:02:22,402 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,403 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,420 INFO [Listener at localhost/38713] util.FSUtils(479): Created version file at hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b with version=8 2023-02-14 11:02:22,420 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,421 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,422 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/hbase-staging 2023-02-14 11:02:22,423 INFO [Listener at localhost/38713] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:22,424 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:22,424 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:22,424 INFO [Listener at localhost/38713] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:22,424 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:22,424 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:22,424 INFO [Listener at localhost/38713] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:22,425 INFO [Listener at localhost/38713] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35119 2023-02-14 11:02:22,426 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,426 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,427 INFO [Listener at localhost/38713] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35119 connecting to ZooKeeper ensemble=127.0.0.1:60887 2023-02-14 11:02:22,435 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:351190x0, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:22,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35119-0x100527eed850000 connected 2023-02-14 11:02:22,454 DEBUG [Listener at localhost/38713] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:22,454 DEBUG [Listener at localhost/38713] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:22,455 DEBUG [Listener at localhost/38713] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:22,456 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35119 2023-02-14 11:02:22,458 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35119 2023-02-14 11:02:22,458 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35119 2023-02-14 11:02:22,460 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35119 2023-02-14 11:02:22,460 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35119 2023-02-14 11:02:22,460 INFO [Listener at localhost/38713] master.HMaster(444): hbase.rootdir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b, hbase.cluster.distributed=false 2023-02-14 11:02:22,473 INFO [Listener at localhost/38713] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:22,473 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:22,473 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:22,473 INFO [Listener at localhost/38713] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:22,473 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:22,473 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:22,473 INFO [Listener at localhost/38713] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:22,474 INFO [Listener at localhost/38713] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34865 2023-02-14 11:02:22,474 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:22,476 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:22,476 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,477 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,479 INFO [Listener at localhost/38713] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34865 connecting to ZooKeeper ensemble=127.0.0.1:60887 2023-02-14 11:02:22,482 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:348650x0, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:22,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34865-0x100527eed850001 connected 2023-02-14 11:02:22,484 DEBUG [Listener at localhost/38713] zookeeper.ZKUtil(164): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:22,485 DEBUG [Listener at localhost/38713] zookeeper.ZKUtil(164): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:22,485 DEBUG [Listener at localhost/38713] zookeeper.ZKUtil(164): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:22,489 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34865 2023-02-14 11:02:22,490 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34865 2023-02-14 11:02:22,490 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34865 2023-02-14 11:02:22,491 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34865 2023-02-14 11:02:22,492 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34865 2023-02-14 11:02:22,508 INFO [Listener at localhost/38713] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:22,509 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:22,509 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:22,509 INFO [Listener at localhost/38713] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:22,509 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:22,509 INFO [Listener at localhost/38713] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:22,509 INFO [Listener at localhost/38713] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:22,510 INFO [Listener at localhost/38713] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36945 2023-02-14 11:02:22,511 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:22,513 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:22,513 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,514 INFO [Listener at localhost/38713] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,515 INFO [Listener at localhost/38713] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36945 connecting to ZooKeeper ensemble=127.0.0.1:60887 2023-02-14 11:02:22,518 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:369450x0, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:22,519 DEBUG [Listener at localhost/38713] zookeeper.ZKUtil(164): regionserver:369450x0, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:22,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36945-0x100527eed850002 connected 2023-02-14 11:02:22,520 DEBUG [Listener at localhost/38713] zookeeper.ZKUtil(164): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:22,520 DEBUG [Listener at localhost/38713] zookeeper.ZKUtil(164): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:22,523 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36945 2023-02-14 11:02:22,523 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36945 2023-02-14 11:02:22,523 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36945 2023-02-14 11:02:22,524 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36945 2023-02-14 11:02:22,528 DEBUG [Listener at localhost/38713] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36945 2023-02-14 11:02:22,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:22,530 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:22,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:22,533 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:22,533 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:22,533 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:22,533 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:22,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:22,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35119,1676372542423 from backup master directory 2023-02-14 11:02:22,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:22,536 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:22,536 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:22,537 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:22,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:22,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/hbase.id with ID: aed49257-9e28-4359-beaa-9bfd977a1f29 2023-02-14 11:02:22,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:22,565 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:22,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x178e5fa6 to 127.0.0.1:60887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:22,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a53fb34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:22,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:22,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-14 11:02:22,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:22,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/data/master/store-tmp 2023-02-14 11:02:22,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:22,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:22,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:22,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:22,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:22,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:22,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:22,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:22,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/WALs/jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:22,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35119%2C1676372542423, suffix=, logDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/WALs/jenkins-hbase4.apache.org,35119,1676372542423, archiveDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/oldWALs, maxLogs=10 2023-02-14 11:02:22,609 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46275,DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4,DISK] 2023-02-14 11:02:22,609 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37247,DS-f361960d-df09-431b-b43e-cb11522844fb,DISK] 2023-02-14 11:02:22,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/WALs/jenkins-hbase4.apache.org,35119,1676372542423/jenkins-hbase4.apache.org%2C35119%2C1676372542423.1676372542595 2023-02-14 11:02:22,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37247,DS-f361960d-df09-431b-b43e-cb11522844fb,DISK], DatanodeInfoWithStorage[127.0.0.1:46275,DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4,DISK]] 2023-02-14 11:02:22,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:22,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:22,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:22,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:22,614 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:22,615 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-14 11:02:22,615 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-14 11:02:22,615 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:22,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:22,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:22,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:22,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:22,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70752110, jitterRate=0.0542885959148407}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:22,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:22,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-14 11:02:22,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-14 11:02:22,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-14 11:02:22,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-14 11:02:22,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-14 11:02:22,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-14 11:02:22,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-14 11:02:22,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-14 11:02:22,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-14 11:02:22,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-14 11:02:22,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-14 11:02:22,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-14 11:02:22,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-14 11:02:22,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-14 11:02:22,650 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:22,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-14 11:02:22,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-14 11:02:22,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-14 11:02:22,653 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:22,653 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:22,653 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:22,653 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:22,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35119,1676372542423, sessionid=0x100527eed850000, setting cluster-up flag (Was=false) 2023-02-14 11:02:22,658 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:22,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-14 11:02:22,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:22,667 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:22,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-14 11:02:22,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:22,672 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.hbase-snapshot/.tmp 2023-02-14 11:02:22,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:22,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:22,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:22,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:22,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:22,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-14 11:02:22,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:22,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676372572684 2023-02-14 11:02:22,684 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-14 11:02:22,684 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-14 11:02:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-14 11:02:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-14 11:02:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-14 11:02:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-14 11:02:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-14 11:02:22,685 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:22,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-14 11:02:22,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-14 11:02:22,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-14 11:02:22,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-14 11:02:22,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-14 11:02:22,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372542696,5,FailOnTimeoutGroup] 2023-02-14 11:02:22,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372542697,5,FailOnTimeoutGroup] 2023-02-14 11:02:22,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-14 11:02:22,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,704 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:22,704 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:22,704 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b 2023-02-14 11:02:22,714 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:22,715 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:22,716 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/info 2023-02-14 11:02:22,716 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:22,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:22,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:22,718 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:22,719 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:22,719 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:22,719 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:22,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/table 2023-02-14 11:02:22,720 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:22,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:22,721 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740 2023-02-14 11:02:22,722 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740 2023-02-14 11:02:22,723 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:22,724 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:22,726 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:22,726 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72880960, jitterRate=0.08601093292236328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:22,726 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:22,726 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:22,726 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:22,726 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:22,726 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:22,726 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:22,726 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:22,726 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:22,727 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:22,727 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-14 11:02:22,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-14 11:02:22,730 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-14 11:02:22,732 INFO [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(952): ClusterId : aed49257-9e28-4359-beaa-9bfd977a1f29 2023-02-14 11:02:22,732 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-14 11:02:22,732 DEBUG [RS:0;jenkins-hbase4:34865] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:22,732 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(952): ClusterId : aed49257-9e28-4359-beaa-9bfd977a1f29 2023-02-14 11:02:22,732 DEBUG [RS:1;jenkins-hbase4:36945] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:22,737 DEBUG [RS:0;jenkins-hbase4:34865] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:22,737 DEBUG [RS:0;jenkins-hbase4:34865] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:22,737 DEBUG [RS:1;jenkins-hbase4:36945] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:22,738 DEBUG [RS:1;jenkins-hbase4:36945] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:22,739 DEBUG [RS:0;jenkins-hbase4:34865] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:22,741 DEBUG [RS:0;jenkins-hbase4:34865] zookeeper.ReadOnlyZKClient(139): Connect 0x2cccd12a to 127.0.0.1:60887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:22,741 DEBUG [RS:1;jenkins-hbase4:36945] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:22,742 DEBUG [RS:1;jenkins-hbase4:36945] zookeeper.ReadOnlyZKClient(139): Connect 0x42c695a9 to 127.0.0.1:60887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:22,749 DEBUG [RS:0;jenkins-hbase4:34865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@220b3ac3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:22,750 DEBUG [RS:1;jenkins-hbase4:36945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c017381, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:22,750 DEBUG [RS:0;jenkins-hbase4:34865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2634ba5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:22,750 DEBUG [RS:1;jenkins-hbase4:36945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@483efed9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:22,758 DEBUG [RS:1;jenkins-hbase4:36945] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36945 2023-02-14 11:02:22,758 INFO [RS:1;jenkins-hbase4:36945] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:22,758 INFO [RS:1;jenkins-hbase4:36945] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:22,758 DEBUG [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:22,759 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35119,1676372542423 with isa=jenkins-hbase4.apache.org/172.31.14.131:36945, startcode=1676372542508 2023-02-14 11:02:22,759 DEBUG [RS:1;jenkins-hbase4:36945] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:22,761 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40703, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:22,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:22,762 DEBUG [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b 2023-02-14 11:02:22,762 DEBUG [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39115 2023-02-14 11:02:22,762 DEBUG [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:22,762 DEBUG [RS:0;jenkins-hbase4:34865] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34865 2023-02-14 11:02:22,763 INFO [RS:0;jenkins-hbase4:34865] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:22,763 INFO [RS:0;jenkins-hbase4:34865] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:22,763 DEBUG [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:22,764 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:22,764 INFO [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35119,1676372542423 with isa=jenkins-hbase4.apache.org/172.31.14.131:34865, startcode=1676372542472 2023-02-14 11:02:22,764 DEBUG [RS:1;jenkins-hbase4:36945] zookeeper.ZKUtil(162): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:22,764 DEBUG [RS:0;jenkins-hbase4:34865] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:22,764 WARN [RS:1;jenkins-hbase4:36945] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:22,765 INFO [RS:1;jenkins-hbase4:36945] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:22,765 DEBUG [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/WALs/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:22,765 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36945,1676372542508] 2023-02-14 11:02:22,769 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44879, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:22,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:22,770 DEBUG [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b 2023-02-14 11:02:22,770 DEBUG [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39115 2023-02-14 11:02:22,770 DEBUG [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:22,770 DEBUG [RS:1;jenkins-hbase4:36945] zookeeper.ZKUtil(162): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:22,774 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:22,774 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:22,775 DEBUG [RS:0;jenkins-hbase4:34865] zookeeper.ZKUtil(162): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:22,775 WARN [RS:0;jenkins-hbase4:34865] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:22,775 INFO [RS:0;jenkins-hbase4:34865] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:22,775 DEBUG [RS:1;jenkins-hbase4:36945] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:22,775 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34865,1676372542472] 2023-02-14 11:02:22,775 DEBUG [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/WALs/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:22,775 INFO [RS:1;jenkins-hbase4:36945] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:22,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:22,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:22,778 INFO [RS:1;jenkins-hbase4:36945] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:22,779 DEBUG [RS:0;jenkins-hbase4:34865] zookeeper.ZKUtil(162): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:22,779 DEBUG [RS:0;jenkins-hbase4:34865] zookeeper.ZKUtil(162): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:22,780 INFO [RS:1;jenkins-hbase4:36945] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:22,780 INFO [RS:1;jenkins-hbase4:36945] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,780 DEBUG [RS:0;jenkins-hbase4:34865] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:22,780 INFO [RS:0;jenkins-hbase4:34865] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:22,784 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:22,784 INFO [RS:0;jenkins-hbase4:34865] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:22,788 INFO [RS:1;jenkins-hbase4:36945] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,788 INFO [RS:0;jenkins-hbase4:34865] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,789 INFO [RS:0;jenkins-hbase4:34865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,789 INFO [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,789 DEBUG [RS:1;jenkins-hbase4:36945] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,794 INFO [RS:0;jenkins-hbase4:34865] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,794 INFO [RS:1;jenkins-hbase4:36945] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,795 INFO [RS:1;jenkins-hbase4:36945] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,795 INFO [RS:1;jenkins-hbase4:36945] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,795 DEBUG [RS:0;jenkins-hbase4:34865] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:22,798 INFO [RS:0;jenkins-hbase4:34865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,798 INFO [RS:0;jenkins-hbase4:34865] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,798 INFO [RS:0;jenkins-hbase4:34865] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,812 INFO [RS:1;jenkins-hbase4:36945] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:22,812 INFO [RS:1;jenkins-hbase4:36945] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36945,1676372542508-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,812 INFO [RS:0;jenkins-hbase4:34865] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:22,812 INFO [RS:0;jenkins-hbase4:34865] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34865,1676372542472-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:22,827 INFO [RS:0;jenkins-hbase4:34865] regionserver.Replication(203): jenkins-hbase4.apache.org,34865,1676372542472 started 2023-02-14 11:02:22,827 INFO [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34865,1676372542472, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34865, sessionid=0x100527eed850001 2023-02-14 11:02:22,827 DEBUG [RS:0;jenkins-hbase4:34865] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:22,827 DEBUG [RS:0;jenkins-hbase4:34865] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:22,827 DEBUG [RS:0;jenkins-hbase4:34865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34865,1676372542472' 2023-02-14 11:02:22,828 DEBUG [RS:0;jenkins-hbase4:34865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:22,828 DEBUG [RS:0;jenkins-hbase4:34865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:22,828 INFO [RS:1;jenkins-hbase4:36945] regionserver.Replication(203): jenkins-hbase4.apache.org,36945,1676372542508 started 2023-02-14 11:02:22,828 DEBUG [RS:0;jenkins-hbase4:34865] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:22,828 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36945,1676372542508, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36945, sessionid=0x100527eed850002 2023-02-14 11:02:22,828 DEBUG [RS:0;jenkins-hbase4:34865] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:22,828 DEBUG [RS:0;jenkins-hbase4:34865] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:22,828 DEBUG [RS:0;jenkins-hbase4:34865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34865,1676372542472' 2023-02-14 11:02:22,828 DEBUG [RS:0;jenkins-hbase4:34865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:22,828 DEBUG [RS:1;jenkins-hbase4:36945] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:22,829 DEBUG [RS:1;jenkins-hbase4:36945] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:22,829 DEBUG [RS:1;jenkins-hbase4:36945] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36945,1676372542508' 2023-02-14 11:02:22,829 DEBUG [RS:1;jenkins-hbase4:36945] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:22,829 DEBUG [RS:0;jenkins-hbase4:34865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:22,829 DEBUG [RS:1;jenkins-hbase4:36945] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:22,829 DEBUG [RS:0;jenkins-hbase4:34865] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:22,829 INFO [RS:0;jenkins-hbase4:34865] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:22,829 INFO [RS:0;jenkins-hbase4:34865] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:22,829 DEBUG [RS:1;jenkins-hbase4:36945] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:22,829 DEBUG [RS:1;jenkins-hbase4:36945] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:22,829 DEBUG [RS:1;jenkins-hbase4:36945] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:22,829 DEBUG [RS:1;jenkins-hbase4:36945] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36945,1676372542508' 2023-02-14 11:02:22,829 DEBUG [RS:1;jenkins-hbase4:36945] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:22,830 DEBUG [RS:1;jenkins-hbase4:36945] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:22,830 DEBUG [RS:1;jenkins-hbase4:36945] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:22,830 INFO [RS:1;jenkins-hbase4:36945] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:22,830 INFO [RS:1;jenkins-hbase4:36945] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:22,882 DEBUG [jenkins-hbase4:35119] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-14 11:02:22,882 DEBUG [jenkins-hbase4:35119] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:22,884 DEBUG [jenkins-hbase4:35119] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:22,884 DEBUG [jenkins-hbase4:35119] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:22,884 DEBUG [jenkins-hbase4:35119] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:22,885 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36945,1676372542508, state=OPENING 2023-02-14 11:02:22,887 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-14 11:02:22,888 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:22,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:22,888 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:23,043 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:23,043 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:23,045 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51104, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:23,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-14 11:02:23,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:23,050 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36945%2C1676372542508.meta, suffix=.meta, logDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/WALs/jenkins-hbase4.apache.org,36945,1676372542508, archiveDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/oldWALs, maxLogs=32 2023-02-14 11:02:23,067 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37247,DS-f361960d-df09-431b-b43e-cb11522844fb,DISK] 2023-02-14 11:02:23,067 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46275,DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4,DISK] 2023-02-14 11:02:23,069 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/WALs/jenkins-hbase4.apache.org,36945,1676372542508/jenkins-hbase4.apache.org%2C36945%2C1676372542508.meta.1676372543051.meta 2023-02-14 11:02:23,071 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37247,DS-f361960d-df09-431b-b43e-cb11522844fb,DISK], DatanodeInfoWithStorage[127.0.0.1:46275,DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4,DISK]] 2023-02-14 11:02:23,071 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:23,071 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-14 11:02:23,071 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-14 11:02:23,071 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-14 11:02:23,071 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-14 11:02:23,071 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,071 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-14 11:02:23,071 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-14 11:02:23,073 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:23,073 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/info 2023-02-14 11:02:23,074 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/info 2023-02-14 11:02:23,074 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:23,074 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:23,074 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:23,075 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:23,075 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:23,076 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:23,076 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:23,076 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:23,077 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/table 2023-02-14 11:02:23,077 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/table 2023-02-14 11:02:23,077 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:23,078 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:23,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740 2023-02-14 11:02:23,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740 2023-02-14 11:02:23,082 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:23,083 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:23,084 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62463380, jitterRate=-0.06922310590744019}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:23,084 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:23,085 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676372543043 2023-02-14 11:02:23,091 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-14 11:02:23,092 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-14 11:02:23,092 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36945,1676372542508, state=OPEN 2023-02-14 11:02:23,094 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-14 11:02:23,094 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:23,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-14 11:02:23,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36945,1676372542508 in 206 msec 2023-02-14 11:02:23,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-14 11:02:23,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 369 msec 2023-02-14 11:02:23,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 425 msec 2023-02-14 11:02:23,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676372543099, completionTime=-1 2023-02-14 11:02:23,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-14 11:02:23,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-14 11:02:23,104 DEBUG [hconnection-0x7f744d38-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:23,105 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51116, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-14 11:02:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676372603106 2023-02-14 11:02:23,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676372663106 2023-02-14 11:02:23,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-14 11:02:23,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35119,1676372542423-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:23,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35119,1676372542423-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:23,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35119,1676372542423-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:23,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35119, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:23,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:23,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-14 11:02:23,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:23,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-14 11:02:23,114 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-14 11:02:23,115 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:23,116 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:23,117 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/hbase/namespace/36840939277fb9e7449aad713946d91e 2023-02-14 11:02:23,118 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/hbase/namespace/36840939277fb9e7449aad713946d91e empty. 2023-02-14 11:02:23,118 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/hbase/namespace/36840939277fb9e7449aad713946d91e 2023-02-14 11:02:23,118 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-14 11:02:23,131 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:23,133 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 36840939277fb9e7449aad713946d91e, NAME => 'hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,146 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,146 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 36840939277fb9e7449aad713946d91e, disabling compactions & flushes 2023-02-14 11:02:23,147 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:23,147 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:23,147 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. after waiting 0 ms 2023-02-14 11:02:23,147 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:23,147 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:23,147 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 36840939277fb9e7449aad713946d91e: 2023-02-14 11:02:23,149 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:23,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372543150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543150"}]},"ts":"1676372543150"} 2023-02-14 11:02:23,153 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:23,153 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:23,154 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372543153"}]},"ts":"1676372543153"} 2023-02-14 11:02:23,155 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-14 11:02:23,159 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:23,159 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:23,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:23,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:23,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=36840939277fb9e7449aad713946d91e, ASSIGN}] 2023-02-14 11:02:23,165 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=36840939277fb9e7449aad713946d91e, ASSIGN 2023-02-14 11:02:23,165 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=36840939277fb9e7449aad713946d91e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36945,1676372542508; forceNewPlan=false, retain=false 2023-02-14 11:02:23,316 INFO [jenkins-hbase4:35119] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:23,317 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=36840939277fb9e7449aad713946d91e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:23,317 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372543317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543317"}]},"ts":"1676372543317"} 2023-02-14 11:02:23,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 36840939277fb9e7449aad713946d91e, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:23,475 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:23,477 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36945%2C1676372542508, suffix=, logDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/WALs/jenkins-hbase4.apache.org,36945,1676372542508, archiveDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/oldWALs, maxLogs=32 2023-02-14 11:02:23,489 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46275,DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4,DISK] 2023-02-14 11:02:23,489 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37247,DS-f361960d-df09-431b-b43e-cb11522844fb,DISK] 2023-02-14 11:02:23,491 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/WALs/jenkins-hbase4.apache.org,36945,1676372542508/jenkins-hbase4.apache.org%2C36945%2C1676372542508.1676372543477 2023-02-14 11:02:23,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37247,DS-f361960d-df09-431b-b43e-cb11522844fb,DISK], DatanodeInfoWithStorage[127.0.0.1:46275,DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4,DISK]] 2023-02-14 11:02:23,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 36840939277fb9e7449aad713946d91e, NAME => 'hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:23,492 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 36840939277fb9e7449aad713946d91e 2023-02-14 11:02:23,492 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,492 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 36840939277fb9e7449aad713946d91e 2023-02-14 11:02:23,492 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 36840939277fb9e7449aad713946d91e 2023-02-14 11:02:23,493 INFO [StoreOpener-36840939277fb9e7449aad713946d91e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 36840939277fb9e7449aad713946d91e 2023-02-14 11:02:23,494 DEBUG [StoreOpener-36840939277fb9e7449aad713946d91e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e/info 2023-02-14 11:02:23,494 DEBUG [StoreOpener-36840939277fb9e7449aad713946d91e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e/info 2023-02-14 11:02:23,495 INFO [StoreOpener-36840939277fb9e7449aad713946d91e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36840939277fb9e7449aad713946d91e columnFamilyName info 2023-02-14 11:02:23,495 INFO [StoreOpener-36840939277fb9e7449aad713946d91e-1] regionserver.HStore(310): Store=36840939277fb9e7449aad713946d91e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:23,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e 2023-02-14 11:02:23,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e 2023-02-14 11:02:23,498 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 36840939277fb9e7449aad713946d91e 2023-02-14 11:02:23,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:23,500 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 36840939277fb9e7449aad713946d91e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68105013, jitterRate=0.014843776822090149}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:23,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 36840939277fb9e7449aad713946d91e: 2023-02-14 11:02:23,501 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e., pid=6, masterSystemTime=1676372543472 2023-02-14 11:02:23,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:23,503 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:23,504 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=36840939277fb9e7449aad713946d91e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:23,504 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372543504"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372543504"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372543504"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372543504"}]},"ts":"1676372543504"} 2023-02-14 11:02:23,507 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-14 11:02:23,507 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 36840939277fb9e7449aad713946d91e, server=jenkins-hbase4.apache.org,36945,1676372542508 in 186 msec 2023-02-14 11:02:23,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-14 11:02:23,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=36840939277fb9e7449aad713946d91e, ASSIGN in 347 msec 2023-02-14 11:02:23,509 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:23,509 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372543509"}]},"ts":"1676372543509"} 2023-02-14 11:02:23,510 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-14 11:02:23,512 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:23,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 399 msec 2023-02-14 11:02:23,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-14 11:02:23,516 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:23,516 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:23,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-14 11:02:23,526 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:23,530 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-14 11:02:23,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-14 11:02:23,547 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:23,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-14 11:02:23,556 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-14 11:02:23,560 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-14 11:02:23,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.023sec 2023-02-14 11:02:23,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-14 11:02:23,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-14 11:02:23,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-14 11:02:23,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35119,1676372542423-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-14 11:02:23,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35119,1676372542423-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-14 11:02:23,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-14 11:02:23,631 DEBUG [Listener at localhost/38713] zookeeper.ReadOnlyZKClient(139): Connect 0x521568ba to 127.0.0.1:60887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:23,635 DEBUG [Listener at localhost/38713] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76c1080e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:23,637 DEBUG [hconnection-0x2cd86a5e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:23,638 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54896, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:23,640 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:23,640 DEBUG [Listener at localhost/38713] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-14 11:02:23,642 DEBUG [Listener at localhost/38713] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-14 11:02:23,643 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43878, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-14 11:02:23,644 INFO [Listener at localhost/38713] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-14 11:02:23,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-14 11:02:23,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-14 11:02:23,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:43878 deadline: 1676372603644, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-14 11:02:23,645 INFO [Listener at localhost/38713] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-14 11:02:23,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:23,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:23,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:23,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-14 11:02:23,650 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:23,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f empty. 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a empty. 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba empty. 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf empty. 2023-02-14 11:02:23,657 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08 empty. 2023-02-14 11:02:23,658 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1 empty. 2023-02-14 11:02:23,658 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:23,658 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:23,658 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:23,658 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:23,658 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:23,658 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051 empty. 2023-02-14 11:02:23,658 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:23,658 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929 empty. 2023-02-14 11:02:23,659 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0 empty. 2023-02-14 11:02:23,659 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:23,659 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:23,659 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:23,659 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:23,659 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051 2023-02-14 11:02:23,659 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9 empty. 2023-02-14 11:02:23,660 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:23,660 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-14 11:02:23,668 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:23,670 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 995fffd3a5c23e591215d7a97da978d1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,670 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 87ac88c2c3ae013a48660aaeb7fb5d1f, NAME => 'testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,670 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => b60430326013b2911b9ad16f73387051, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,673 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-14 11:02:23,692 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,692 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,693 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 87ac88c2c3ae013a48660aaeb7fb5d1f, disabling compactions & flushes 2023-02-14 11:02:23,693 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing b60430326013b2911b9ad16f73387051, disabling compactions & flushes 2023-02-14 11:02:23,693 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:23,693 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:23,693 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:23,693 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:23,693 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. after waiting 0 ms 2023-02-14 11:02:23,693 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. after waiting 0 ms 2023-02-14 11:02:23,694 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:23,693 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:23,694 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:23,694 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:23,694 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for b60430326013b2911b9ad16f73387051: 2023-02-14 11:02:23,694 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 87ac88c2c3ae013a48660aaeb7fb5d1f: 2023-02-14 11:02:23,695 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7c21ca5b583a87d0af772952445db929, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,695 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8355f8ee1888a80f5a9e75984303dbba, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,696 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,696 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 995fffd3a5c23e591215d7a97da978d1, disabling compactions & flushes 2023-02-14 11:02:23,696 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:23,696 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:23,696 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. after waiting 0 ms 2023-02-14 11:02:23,696 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:23,696 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:23,696 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 995fffd3a5c23e591215d7a97da978d1: 2023-02-14 11:02:23,696 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => d48fba694cc4111247235c15bb0d20bf, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing d48fba694cc4111247235c15bb0d20bf, disabling compactions & flushes 2023-02-14 11:02:23,724 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:23,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:23,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 8355f8ee1888a80f5a9e75984303dbba, disabling compactions & flushes 2023-02-14 11:02:23,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. after waiting 0 ms 2023-02-14 11:02:23,725 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:23,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:23,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:23,725 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:23,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for d48fba694cc4111247235c15bb0d20bf: 2023-02-14 11:02:23,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. after waiting 0 ms 2023-02-14 11:02:23,725 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:23,726 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => e2ffb9a970fd073a9759e7c9eec1df7a, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,726 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:23,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 8355f8ee1888a80f5a9e75984303dbba: 2023-02-14 11:02:23,727 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 479b6d884849ef224df69ab884ab6a08, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,730 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,730 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 7c21ca5b583a87d0af772952445db929, disabling compactions & flushes 2023-02-14 11:02:23,731 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:23,731 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:23,731 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. after waiting 0 ms 2023-02-14 11:02:23,731 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:23,731 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:23,731 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 7c21ca5b583a87d0af772952445db929: 2023-02-14 11:02:23,731 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => d7cc1d2fd940e022c086ab65d19763a0, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,749 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,750 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing d7cc1d2fd940e022c086ab65d19763a0, disabling compactions & flushes 2023-02-14 11:02:23,750 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:23,750 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:23,750 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. after waiting 0 ms 2023-02-14 11:02:23,750 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:23,750 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:23,750 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for d7cc1d2fd940e022c086ab65d19763a0: 2023-02-14 11:02:23,750 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3928dba47559f8475d4b79a057a785e9, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp 2023-02-14 11:02:23,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:23,757 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,757 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing e2ffb9a970fd073a9759e7c9eec1df7a, disabling compactions & flushes 2023-02-14 11:02:23,757 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:23,757 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:23,757 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. after waiting 0 ms 2023-02-14 11:02:23,757 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:23,757 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:23,757 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for e2ffb9a970fd073a9759e7c9eec1df7a: 2023-02-14 11:02:23,757 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,757 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 479b6d884849ef224df69ab884ab6a08, disabling compactions & flushes 2023-02-14 11:02:23,758 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:23,758 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:23,758 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. after waiting 0 ms 2023-02-14 11:02:23,758 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:23,758 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:23,758 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 479b6d884849ef224df69ab884ab6a08: 2023-02-14 11:02:23,768 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:23,768 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 3928dba47559f8475d4b79a057a785e9, disabling compactions & flushes 2023-02-14 11:02:23,768 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:23,768 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:23,768 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. after waiting 0 ms 2023-02-14 11:02:23,768 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:23,768 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:23,768 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 3928dba47559f8475d4b79a057a785e9: 2023-02-14 11:02:23,771 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372543771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372543771"}]},"ts":"1676372543771"} 2023-02-14 11:02:23,777 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-14 11:02:23,781 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:23,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372543781"}]},"ts":"1676372543781"} 2023-02-14 11:02:23,782 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-14 11:02:23,786 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:23,791 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:23,791 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:23,791 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:23,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac88c2c3ae013a48660aaeb7fb5d1f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b60430326013b2911b9ad16f73387051, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=995fffd3a5c23e591215d7a97da978d1, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c21ca5b583a87d0af772952445db929, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8355f8ee1888a80f5a9e75984303dbba, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d48fba694cc4111247235c15bb0d20bf, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2ffb9a970fd073a9759e7c9eec1df7a, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=479b6d884849ef224df69ab884ab6a08, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7cc1d2fd940e022c086ab65d19763a0, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3928dba47559f8475d4b79a057a785e9, ASSIGN}] 2023-02-14 11:02:23,794 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac88c2c3ae013a48660aaeb7fb5d1f, ASSIGN 2023-02-14 11:02:23,794 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b60430326013b2911b9ad16f73387051, ASSIGN 2023-02-14 11:02:23,795 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=995fffd3a5c23e591215d7a97da978d1, ASSIGN 2023-02-14 11:02:23,795 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=479b6d884849ef224df69ab884ab6a08, ASSIGN 2023-02-14 11:02:23,795 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac88c2c3ae013a48660aaeb7fb5d1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36945,1676372542508; forceNewPlan=false, retain=false 2023-02-14 11:02:23,795 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b60430326013b2911b9ad16f73387051, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34865,1676372542472; forceNewPlan=false, retain=false 2023-02-14 11:02:23,795 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=995fffd3a5c23e591215d7a97da978d1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34865,1676372542472; forceNewPlan=false, retain=false 2023-02-14 11:02:23,796 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=479b6d884849ef224df69ab884ab6a08, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34865,1676372542472; forceNewPlan=false, retain=false 2023-02-14 11:02:23,796 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7cc1d2fd940e022c086ab65d19763a0, ASSIGN 2023-02-14 11:02:23,796 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3928dba47559f8475d4b79a057a785e9, ASSIGN 2023-02-14 11:02:23,796 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2ffb9a970fd073a9759e7c9eec1df7a, ASSIGN 2023-02-14 11:02:23,796 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d48fba694cc4111247235c15bb0d20bf, ASSIGN 2023-02-14 11:02:23,796 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8355f8ee1888a80f5a9e75984303dbba, ASSIGN 2023-02-14 11:02:23,797 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7cc1d2fd940e022c086ab65d19763a0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34865,1676372542472; forceNewPlan=false, retain=false 2023-02-14 11:02:23,797 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2ffb9a970fd073a9759e7c9eec1df7a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36945,1676372542508; forceNewPlan=false, retain=false 2023-02-14 11:02:23,797 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d48fba694cc4111247235c15bb0d20bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36945,1676372542508; forceNewPlan=false, retain=false 2023-02-14 11:02:23,797 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3928dba47559f8475d4b79a057a785e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36945,1676372542508; forceNewPlan=false, retain=false 2023-02-14 11:02:23,797 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c21ca5b583a87d0af772952445db929, ASSIGN 2023-02-14 11:02:23,797 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8355f8ee1888a80f5a9e75984303dbba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34865,1676372542472; forceNewPlan=false, retain=false 2023-02-14 11:02:23,798 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c21ca5b583a87d0af772952445db929, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36945,1676372542508; forceNewPlan=false, retain=false 2023-02-14 11:02:23,831 INFO [RS:0;jenkins-hbase4:34865] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34865%2C1676372542472, suffix=, logDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/WALs/jenkins-hbase4.apache.org,34865,1676372542472, archiveDir=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/oldWALs, maxLogs=32 2023-02-14 11:02:23,854 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46275,DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4,DISK] 2023-02-14 11:02:23,854 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37247,DS-f361960d-df09-431b-b43e-cb11522844fb,DISK] 2023-02-14 11:02:23,856 INFO [RS:0;jenkins-hbase4:34865] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/WALs/jenkins-hbase4.apache.org,34865,1676372542472/jenkins-hbase4.apache.org%2C34865%2C1676372542472.1676372543832 2023-02-14 11:02:23,856 DEBUG [RS:0;jenkins-hbase4:34865] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46275,DS-cf2447ae-467f-41cf-9bda-b95ab1e0c1a4,DISK], DatanodeInfoWithStorage[127.0.0.1:37247,DS-f361960d-df09-431b-b43e-cb11522844fb,DISK]] 2023-02-14 11:02:23,945 INFO [jenkins-hbase4:35119] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-14 11:02:23,951 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7c21ca5b583a87d0af772952445db929, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:23,951 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=87ac88c2c3ae013a48660aaeb7fb5d1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:23,951 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3928dba47559f8475d4b79a057a785e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:23,951 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e2ffb9a970fd073a9759e7c9eec1df7a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:23,952 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372543951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543951"}]},"ts":"1676372543951"} 2023-02-14 11:02:23,951 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d48fba694cc4111247235c15bb0d20bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:23,952 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543951"}]},"ts":"1676372543951"} 2023-02-14 11:02:23,952 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372543951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543951"}]},"ts":"1676372543951"} 2023-02-14 11:02:23,952 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543951"}]},"ts":"1676372543951"} 2023-02-14 11:02:23,952 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543951"}]},"ts":"1676372543951"} 2023-02-14 11:02:23,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 3928dba47559f8475d4b79a057a785e9, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:23,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=17, state=RUNNABLE; OpenRegionProcedure e2ffb9a970fd073a9759e7c9eec1df7a, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:23,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:23,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 87ac88c2c3ae013a48660aaeb7fb5d1f, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:23,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure 7c21ca5b583a87d0af772952445db929, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:23,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=16, state=RUNNABLE; OpenRegionProcedure d48fba694cc4111247235c15bb0d20bf, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:23,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d7cc1d2fd940e022c086ab65d19763a0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:23,957 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543957"}]},"ts":"1676372543957"} 2023-02-14 11:02:23,957 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=479b6d884849ef224df69ab884ab6a08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:23,957 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543957"}]},"ts":"1676372543957"} 2023-02-14 11:02:23,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=995fffd3a5c23e591215d7a97da978d1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:23,959 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543959"}]},"ts":"1676372543959"} 2023-02-14 11:02:23,960 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=b60430326013b2911b9ad16f73387051, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:23,960 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543960"}]},"ts":"1676372543960"} 2023-02-14 11:02:23,961 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8355f8ee1888a80f5a9e75984303dbba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:23,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure d7cc1d2fd940e022c086ab65d19763a0, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:23,961 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372543960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372543960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372543960"}]},"ts":"1676372543960"} 2023-02-14 11:02:23,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure 479b6d884849ef224df69ab884ab6a08, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:23,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 995fffd3a5c23e591215d7a97da978d1, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:23,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure b60430326013b2911b9ad16f73387051, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:23,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 8355f8ee1888a80f5a9e75984303dbba, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:24,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:24,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 87ac88c2c3ae013a48660aaeb7fb5d1f, NAME => 'testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-14 11:02:24,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:24,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:24,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:24,112 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:24,113 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,113 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:24,113 DEBUG [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/f1 2023-02-14 11:02:24,113 DEBUG [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/f1 2023-02-14 11:02:24,113 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ac88c2c3ae013a48660aaeb7fb5d1f columnFamilyName f1 2023-02-14 11:02:24,114 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] regionserver.HStore(310): Store=87ac88c2c3ae013a48660aaeb7fb5d1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,114 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:24,114 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37202, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:24,115 DEBUG [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/f2 2023-02-14 11:02:24,115 DEBUG [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/f2 2023-02-14 11:02:24,116 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ac88c2c3ae013a48660aaeb7fb5d1f columnFamilyName f2 2023-02-14 11:02:24,116 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] regionserver.HStore(310): Store=87ac88c2c3ae013a48660aaeb7fb5d1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:24,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:24,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d7cc1d2fd940e022c086ab65d19763a0, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-14 11:02:24,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:24,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:24,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:24,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:24,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:24,122 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:24,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 87ac88c2c3ae013a48660aaeb7fb5d1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70408630, jitterRate=0.049170345067977905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 87ac88c2c3ae013a48660aaeb7fb5d1f: 2023-02-14 11:02:24,123 DEBUG [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1 2023-02-14 11:02:24,123 DEBUG [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1 2023-02-14 11:02:24,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f., pid=23, masterSystemTime=1676372544105 2023-02-14 11:02:24,124 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7cc1d2fd940e022c086ab65d19763a0 columnFamilyName f1 2023-02-14 11:02:24,124 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(310): Store=d7cc1d2fd940e022c086ab65d19763a0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,124 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:24,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:24,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:24,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:24,126 DEBUG [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2 2023-02-14 11:02:24,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3928dba47559f8475d4b79a057a785e9, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-14 11:02:24,126 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=87ac88c2c3ae013a48660aaeb7fb5d1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,126 DEBUG [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2 2023-02-14 11:02:24,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:24,126 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372544126"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544126"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544126"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544126"}]},"ts":"1676372544126"} 2023-02-14 11:02:24,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:24,126 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7cc1d2fd940e022c086ab65d19763a0 columnFamilyName f2 2023-02-14 11:02:24,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:24,127 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(310): Store=d7cc1d2fd940e022c086ab65d19763a0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,127 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:24,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:24,129 DEBUG [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/f1 2023-02-14 11:02:24,129 DEBUG [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/f1 2023-02-14 11:02:24,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-14 11:02:24,130 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3928dba47559f8475d4b79a057a785e9 columnFamilyName f1 2023-02-14 11:02:24,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 87ac88c2c3ae013a48660aaeb7fb5d1f, server=jenkins-hbase4.apache.org,36945,1676372542508 in 172 msec 2023-02-14 11:02:24,130 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] regionserver.HStore(310): Store=3928dba47559f8475d4b79a057a785e9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,130 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:24,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:24,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac88c2c3ae013a48660aaeb7fb5d1f, ASSIGN in 338 msec 2023-02-14 11:02:24,132 DEBUG [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/f2 2023-02-14 11:02:24,132 DEBUG [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/f2 2023-02-14 11:02:24,133 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3928dba47559f8475d4b79a057a785e9 columnFamilyName f2 2023-02-14 11:02:24,133 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] regionserver.HStore(310): Store=3928dba47559f8475d4b79a057a785e9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:24,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d7cc1d2fd940e022c086ab65d19763a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65601535, jitterRate=-0.022460952401161194}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d7cc1d2fd940e022c086ab65d19763a0: 2023-02-14 11:02:24,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0., pid=26, masterSystemTime=1676372544112 2023-02-14 11:02:24,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:24,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:24,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:24,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b60430326013b2911b9ad16f73387051, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-14 11:02:24,142 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d7cc1d2fd940e022c086ab65d19763a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b60430326013b2911b9ad16f73387051 2023-02-14 11:02:24,142 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372544142"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544142"}]},"ts":"1676372544142"} 2023-02-14 11:02:24,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b60430326013b2911b9ad16f73387051 2023-02-14 11:02:24,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b60430326013b2911b9ad16f73387051 2023-02-14 11:02:24,143 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b60430326013b2911b9ad16f73387051 2023-02-14 11:02:24,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:24,145 DEBUG [StoreOpener-b60430326013b2911b9ad16f73387051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1 2023-02-14 11:02:24,145 DEBUG [StoreOpener-b60430326013b2911b9ad16f73387051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1 2023-02-14 11:02:24,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-14 11:02:24,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure d7cc1d2fd940e022c086ab65d19763a0, server=jenkins-hbase4.apache.org,34865,1676372542472 in 183 msec 2023-02-14 11:02:24,145 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b60430326013b2911b9ad16f73387051 columnFamilyName f1 2023-02-14 11:02:24,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,146 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(310): Store=b60430326013b2911b9ad16f73387051/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,146 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b60430326013b2911b9ad16f73387051 2023-02-14 11:02:24,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3928dba47559f8475d4b79a057a785e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59125997, jitterRate=-0.11895398795604706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3928dba47559f8475d4b79a057a785e9: 2023-02-14 11:02:24,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7cc1d2fd940e022c086ab65d19763a0, ASSIGN in 353 msec 2023-02-14 11:02:24,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9., pid=21, masterSystemTime=1676372544105 2023-02-14 11:02:24,147 DEBUG [StoreOpener-b60430326013b2911b9ad16f73387051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2 2023-02-14 11:02:24,147 DEBUG [StoreOpener-b60430326013b2911b9ad16f73387051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2 2023-02-14 11:02:24,148 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b60430326013b2911b9ad16f73387051 columnFamilyName f2 2023-02-14 11:02:24,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:24,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:24,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:24,148 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(310): Store=b60430326013b2911b9ad16f73387051/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e2ffb9a970fd073a9759e7c9eec1df7a, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-14 11:02:24,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:24,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:24,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:24,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051 2023-02-14 11:02:24,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3928dba47559f8475d4b79a057a785e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,149 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372544149"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544149"}]},"ts":"1676372544149"} 2023-02-14 11:02:24,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051 2023-02-14 11:02:24,150 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:24,151 DEBUG [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1 2023-02-14 11:02:24,151 DEBUG [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1 2023-02-14 11:02:24,151 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2ffb9a970fd073a9759e7c9eec1df7a columnFamilyName f1 2023-02-14 11:02:24,151 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(310): Store=e2ffb9a970fd073a9759e7c9eec1df7a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,152 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:24,153 DEBUG [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2 2023-02-14 11:02:24,153 DEBUG [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2 2023-02-14 11:02:24,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-14 11:02:24,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b60430326013b2911b9ad16f73387051 2023-02-14 11:02:24,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 3928dba47559f8475d4b79a057a785e9, server=jenkins-hbase4.apache.org,36945,1676372542508 in 198 msec 2023-02-14 11:02:24,153 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2ffb9a970fd073a9759e7c9eec1df7a columnFamilyName f2 2023-02-14 11:02:24,154 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(310): Store=e2ffb9a970fd073a9759e7c9eec1df7a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:24,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3928dba47559f8475d4b79a057a785e9, ASSIGN in 361 msec 2023-02-14 11:02:24,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:24,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b60430326013b2911b9ad16f73387051; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74945257, jitterRate=0.11677135527133942}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b60430326013b2911b9ad16f73387051: 2023-02-14 11:02:24,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051., pid=29, masterSystemTime=1676372544112 2023-02-14 11:02:24,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:24,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:24,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8355f8ee1888a80f5a9e75984303dbba, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-14 11:02:24,158 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=b60430326013b2911b9ad16f73387051, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,158 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372544158"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544158"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544158"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544158"}]},"ts":"1676372544158"} 2023-02-14 11:02:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:24,159 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:24,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,161 DEBUG [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1 2023-02-14 11:02:24,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e2ffb9a970fd073a9759e7c9eec1df7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60008320, jitterRate=-0.10580635070800781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,161 DEBUG [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1 2023-02-14 11:02:24,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-14 11:02:24,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e2ffb9a970fd073a9759e7c9eec1df7a: 2023-02-14 11:02:24,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure b60430326013b2911b9ad16f73387051, server=jenkins-hbase4.apache.org,34865,1676372542472 in 195 msec 2023-02-14 11:02:24,161 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8355f8ee1888a80f5a9e75984303dbba columnFamilyName f1 2023-02-14 11:02:24,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a., pid=22, masterSystemTime=1676372544105 2023-02-14 11:02:24,161 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(310): Store=8355f8ee1888a80f5a9e75984303dbba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,162 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:24,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b60430326013b2911b9ad16f73387051, ASSIGN in 369 msec 2023-02-14 11:02:24,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:24,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:24,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:24,163 DEBUG [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2 2023-02-14 11:02:24,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d48fba694cc4111247235c15bb0d20bf, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-14 11:02:24,163 DEBUG [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2 2023-02-14 11:02:24,163 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e2ffb9a970fd073a9759e7c9eec1df7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:24,163 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372544163"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544163"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544163"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544163"}]},"ts":"1676372544163"} 2023-02-14 11:02:24,163 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8355f8ee1888a80f5a9e75984303dbba columnFamilyName f2 2023-02-14 11:02:24,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:24,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:24,164 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(310): Store=8355f8ee1888a80f5a9e75984303dbba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:24,165 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:24,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:24,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=17 2023-02-14 11:02:24,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=17, state=SUCCESS; OpenRegionProcedure e2ffb9a970fd073a9759e7c9eec1df7a, server=jenkins-hbase4.apache.org,36945,1676372542508 in 211 msec 2023-02-14 11:02:24,166 DEBUG [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1 2023-02-14 11:02:24,167 DEBUG [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1 2023-02-14 11:02:24,167 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d48fba694cc4111247235c15bb0d20bf columnFamilyName f1 2023-02-14 11:02:24,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2ffb9a970fd073a9759e7c9eec1df7a, ASSIGN in 374 msec 2023-02-14 11:02:24,167 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(310): Store=d48fba694cc4111247235c15bb0d20bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,167 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:24,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:24,169 DEBUG [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2 2023-02-14 11:02:24,169 DEBUG [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2 2023-02-14 11:02:24,169 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d48fba694cc4111247235c15bb0d20bf columnFamilyName f2 2023-02-14 11:02:24,170 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(310): Store=d48fba694cc4111247235c15bb0d20bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:24,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:24,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8355f8ee1888a80f5a9e75984303dbba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64208209, jitterRate=-0.04322312772274017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8355f8ee1888a80f5a9e75984303dbba: 2023-02-14 11:02:24,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba., pid=30, masterSystemTime=1676372544112 2023-02-14 11:02:24,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:24,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:24,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 995fffd3a5c23e591215d7a97da978d1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-14 11:02:24,173 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8355f8ee1888a80f5a9e75984303dbba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:24,173 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372544173"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544173"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544173"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544173"}]},"ts":"1676372544173"} 2023-02-14 11:02:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:24,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:24,174 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:24,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-14 11:02:24,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 8355f8ee1888a80f5a9e75984303dbba, server=jenkins-hbase4.apache.org,34865,1676372542472 in 209 msec 2023-02-14 11:02:24,176 DEBUG [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1 2023-02-14 11:02:24,176 DEBUG [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1 2023-02-14 11:02:24,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d48fba694cc4111247235c15bb0d20bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65185132, jitterRate=-0.02866584062576294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,176 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 995fffd3a5c23e591215d7a97da978d1 columnFamilyName f1 2023-02-14 11:02:24,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d48fba694cc4111247235c15bb0d20bf: 2023-02-14 11:02:24,177 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(310): Store=995fffd3a5c23e591215d7a97da978d1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8355f8ee1888a80f5a9e75984303dbba, ASSIGN in 384 msec 2023-02-14 11:02:24,177 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:24,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf., pid=25, masterSystemTime=1676372544105 2023-02-14 11:02:24,179 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d48fba694cc4111247235c15bb0d20bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,179 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372544179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544179"}]},"ts":"1676372544179"} 2023-02-14 11:02:24,179 DEBUG [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2 2023-02-14 11:02:24,179 DEBUG [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2 2023-02-14 11:02:24,180 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 995fffd3a5c23e591215d7a97da978d1 columnFamilyName f2 2023-02-14 11:02:24,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:24,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:24,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:24,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7c21ca5b583a87d0af772952445db929, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-14 11:02:24,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:24,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:24,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:24,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=16 2023-02-14 11:02:24,182 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(310): Store=995fffd3a5c23e591215d7a97da978d1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=16, state=SUCCESS; OpenRegionProcedure d48fba694cc4111247235c15bb0d20bf, server=jenkins-hbase4.apache.org,36945,1676372542508 in 225 msec 2023-02-14 11:02:24,183 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:24,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d48fba694cc4111247235c15bb0d20bf, ASSIGN in 390 msec 2023-02-14 11:02:24,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:24,185 DEBUG [StoreOpener-7c21ca5b583a87d0af772952445db929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1 2023-02-14 11:02:24,185 DEBUG [StoreOpener-7c21ca5b583a87d0af772952445db929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1 2023-02-14 11:02:24,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:24,185 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c21ca5b583a87d0af772952445db929 columnFamilyName f1 2023-02-14 11:02:24,186 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(310): Store=7c21ca5b583a87d0af772952445db929/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,186 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:24,187 DEBUG [StoreOpener-7c21ca5b583a87d0af772952445db929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2 2023-02-14 11:02:24,187 DEBUG [StoreOpener-7c21ca5b583a87d0af772952445db929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2 2023-02-14 11:02:24,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,187 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c21ca5b583a87d0af772952445db929 columnFamilyName f2 2023-02-14 11:02:24,188 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(310): Store=7c21ca5b583a87d0af772952445db929/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:24,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:24,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 995fffd3a5c23e591215d7a97da978d1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69764627, jitterRate=0.03957395255565643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 995fffd3a5c23e591215d7a97da978d1: 2023-02-14 11:02:24,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1., pid=28, masterSystemTime=1676372544112 2023-02-14 11:02:24,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:24,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:24,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:24,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 479b6d884849ef224df69ab884ab6a08, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-14 11:02:24,193 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=995fffd3a5c23e591215d7a97da978d1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:24,193 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372544193"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544193"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544193"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544193"}]},"ts":"1676372544193"} 2023-02-14 11:02:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:24,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,194 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:24,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7c21ca5b583a87d0af772952445db929; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64335373, jitterRate=-0.04132823646068573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7c21ca5b583a87d0af772952445db929: 2023-02-14 11:02:24,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929., pid=24, masterSystemTime=1676372544105 2023-02-14 11:02:24,195 DEBUG [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1 2023-02-14 11:02:24,195 DEBUG [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1 2023-02-14 11:02:24,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-14 11:02:24,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 995fffd3a5c23e591215d7a97da978d1, server=jenkins-hbase4.apache.org,34865,1676372542472 in 232 msec 2023-02-14 11:02:24,196 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 479b6d884849ef224df69ab884ab6a08 columnFamilyName f1 2023-02-14 11:02:24,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:24,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:24,196 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7c21ca5b583a87d0af772952445db929, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,196 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372544196"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544196"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544196"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544196"}]},"ts":"1676372544196"} 2023-02-14 11:02:24,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=995fffd3a5c23e591215d7a97da978d1, ASSIGN in 404 msec 2023-02-14 11:02:24,197 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(310): Store=479b6d884849ef224df69ab884ab6a08/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,197 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:24,198 DEBUG [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2 2023-02-14 11:02:24,198 DEBUG [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2 2023-02-14 11:02:24,198 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 479b6d884849ef224df69ab884ab6a08 columnFamilyName f2 2023-02-14 11:02:24,199 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(310): Store=479b6d884849ef224df69ab884ab6a08/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:24,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-14 11:02:24,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure 7c21ca5b583a87d0af772952445db929, server=jenkins-hbase4.apache.org,36945,1676372542508 in 243 msec 2023-02-14 11:02:24,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:24,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c21ca5b583a87d0af772952445db929, ASSIGN in 407 msec 2023-02-14 11:02:24,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:24,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:24,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:24,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:24,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 479b6d884849ef224df69ab884ab6a08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73780794, jitterRate=0.099419504404068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:24,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 479b6d884849ef224df69ab884ab6a08: 2023-02-14 11:02:24,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08., pid=27, masterSystemTime=1676372544112 2023-02-14 11:02:24,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:24,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:24,205 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=479b6d884849ef224df69ab884ab6a08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,205 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372544205"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372544205"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372544205"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372544205"}]},"ts":"1676372544205"} 2023-02-14 11:02:24,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-14 11:02:24,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure 479b6d884849ef224df69ab884ab6a08, server=jenkins-hbase4.apache.org,34865,1676372542472 in 245 msec 2023-02-14 11:02:24,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-14 11:02:24,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=479b6d884849ef224df69ab884ab6a08, ASSIGN in 415 msec 2023-02-14 11:02:24,209 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:24,209 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372544209"}]},"ts":"1676372544209"} 2023-02-14 11:02:24,210 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-14 11:02:24,212 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:24,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 565 msec 2023-02-14 11:02:24,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:24,256 INFO [Listener at localhost/38713] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-14 11:02:24,256 DEBUG [Listener at localhost/38713] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-14 11:02:24,256 INFO [Listener at localhost/38713] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:24,259 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-14 11:02:24,259 INFO [Listener at localhost/38713] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:24,259 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-14 11:02:24,259 INFO [Listener at localhost/38713] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-14 11:02:24,295 DEBUG [hconnection-0x2cd86a5e-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:24,300 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36945] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:24,308 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37214, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:24,315 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34865] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:24,416 INFO [Listener at localhost/38713] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-14 11:02:24,416 INFO [Listener at localhost/38713] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-14 11:02:24,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-14 11:02:24,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676372544417 (current time:1676372544417). 2023-02-14 11:02:24,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-14 11:02:24,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] zookeeper.ReadOnlyZKClient(139): Connect 0x1db36148 to 127.0.0.1:60887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:24,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f536cfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:24,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:24,424 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54902, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:24,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1db36148 to 127.0.0.1:60887 2023-02-14 11:02:24,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:24,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-14 11:02:24,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-14 11:02:24,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-14 11:02:24,428 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-14 11:02:24,429 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676373144429 2023-02-14 11:02:24,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-14 11:02:24,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,433 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-14 11:02:24,433 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:24,433 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-14 11:02:24,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-14 11:02:24,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-14 11:02:24,434 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-14 11:02:24,435 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676373144435 2023-02-14 11:02:24,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,448 INFO [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-14 11:02:24,448 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:24,449 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-14 11:02:24,449 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-14 11:02:24,449 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,449 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,450 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:24,450 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:24,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:24,450 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:24,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:24,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:24,452 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,452 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,452 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,452 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:24,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-14 11:02:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-14 11:02:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,453 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-14 11:02:24,453 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-14 11:02:24,453 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,456 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-14 11:02:24,456 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-14 11:02:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-14 11:02:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36945,1676372542508' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-14 11:02:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-14 11:02:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-14 11:02:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-14 11:02:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34865,1676372542472' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-14 11:02:24,463 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,463 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:24,464 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:24,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:24,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36945,1676372542508' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-14 11:02:24,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@410280d6[Count = 1] remaining members to acquire global barrier 2023-02-14 11:02:24,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:24,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:24,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34865,1676372542472' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-14 11:02:24,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@410280d6[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:24,467 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-14 11:02:24,467 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,470 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,470 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,470 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-14 11:02:24,470 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-14 11:02:24,470 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:24,470 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:24,470 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:24,470 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. started... 2023-02-14 11:02:24,470 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:24,470 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:24,470 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:24,471 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 87ac88c2c3ae013a48660aaeb7fb5d1f: 2023-02-14 11:02:24,470 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. started... 2023-02-14 11:02:24,471 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-14 11:02:24,471 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:02:24,471 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,470 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. started... 2023-02-14 11:02:24,471 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:24,471 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:24,471 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. started... 2023-02-14 11:02:24,471 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. started... 2023-02-14 11:02:24,472 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-14 11:02:24,472 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:24,472 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:24,472 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:02:24,472 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d7cc1d2fd940e022c086ab65d19763a0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-14 11:02:24,472 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8355f8ee1888a80f5a9e75984303dbba 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:24,472 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 7c21ca5b583a87d0af772952445db929 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:24,472 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:02:24,472 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3928dba47559f8475d4b79a057a785e9: 2023-02-14 11:02:24,472 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:02:24,472 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. started... 2023-02-14 11:02:24,473 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,473 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:24,473 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:02:24,474 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-14 11:02:24,473 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 995fffd3a5c23e591215d7a97da978d1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:24,497 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. completed. 2023-02-14 11:02:24,497 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:24,497 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:24,497 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-14 11:02:24,497 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. started... 2023-02-14 11:02:24,501 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e2ffb9a970fd073a9759e7c9eec1df7a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:24,505 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. completed. 2023-02-14 11:02:24,505 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/.tmp/f1/2a13e5f459664938839c375b8d1e51ab 2023-02-14 11:02:24,505 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:24,505 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:24,505 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-14 11:02:24,505 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. started... 2023-02-14 11:02:24,507 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d48fba694cc4111247235c15bb0d20bf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:24,512 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/.tmp/f1/3e728129848c4d04a8bcaa79520fe628 2023-02-14 11:02:24,524 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/.tmp/f1/77ea7ea4ead14976b0a2bb08b3938b44 2023-02-14 11:02:24,531 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/.tmp/f1/d0d43c7254054dd0ac14d02a2db2bee6 2023-02-14 11:02:24,533 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:24,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-14 11:02:24,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:24,535 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-14 11:02:24,549 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/.tmp/f1/f2481802d9ee41828735ae6462d13ba6 2023-02-14 11:02:24,578 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/.tmp/f2/d09942b31d5f45a3b251568455cf420d 2023-02-14 11:02:24,579 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/.tmp/f1/a6291a22e00a44efaeaa96fb952f0245 2023-02-14 11:02:24,588 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/.tmp/f2/66eaa3d198f84d4e8e6712027dc6580d 2023-02-14 11:02:24,595 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/.tmp/f1/77ea7ea4ead14976b0a2bb08b3938b44 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/77ea7ea4ead14976b0a2bb08b3938b44 2023-02-14 11:02:24,595 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/.tmp/f1/2a13e5f459664938839c375b8d1e51ab as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/2a13e5f459664938839c375b8d1e51ab 2023-02-14 11:02:24,600 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/77ea7ea4ead14976b0a2bb08b3938b44, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:24,600 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/.tmp/f2/66eaa3d198f84d4e8e6712027dc6580d as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/66eaa3d198f84d4e8e6712027dc6580d 2023-02-14 11:02:24,601 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/2a13e5f459664938839c375b8d1e51ab, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:24,601 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/.tmp/f2/d09942b31d5f45a3b251568455cf420d as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/d09942b31d5f45a3b251568455cf420d 2023-02-14 11:02:24,620 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/.tmp/f2/cd6a0ab10230423c806034795eed6424 2023-02-14 11:02:24,620 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/66eaa3d198f84d4e8e6712027dc6580d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:24,622 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/d09942b31d5f45a3b251568455cf420d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:24,622 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8355f8ee1888a80f5a9e75984303dbba in 150ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:24,622 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-14 11:02:24,622 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7c21ca5b583a87d0af772952445db929 in 150ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:24,622 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8355f8ee1888a80f5a9e75984303dbba: 2023-02-14 11:02:24,623 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7c21ca5b583a87d0af772952445db929: 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/77ea7ea4ead14976b0a2bb08b3938b44] hfiles 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/77ea7ea4ead14976b0a2bb08b3938b44 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/66eaa3d198f84d4e8e6712027dc6580d] hfiles 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/66eaa3d198f84d4e8e6712027dc6580d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/2a13e5f459664938839c375b8d1e51ab] hfiles 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/2a13e5f459664938839c375b8d1e51ab for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/d09942b31d5f45a3b251568455cf420d] hfiles 2023-02-14 11:02:24,627 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/d09942b31d5f45a3b251568455cf420d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,632 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/.tmp/f2/0d0598a76039437dbb6d13afe5ee5e5c 2023-02-14 11:02:24,644 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/.tmp/f1/3e728129848c4d04a8bcaa79520fe628 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/3e728129848c4d04a8bcaa79520fe628 2023-02-14 11:02:24,651 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/.tmp/f1/d0d43c7254054dd0ac14d02a2db2bee6 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/d0d43c7254054dd0ac14d02a2db2bee6 2023-02-14 11:02:24,655 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/3e728129848c4d04a8bcaa79520fe628, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:02:24,656 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/d0d43c7254054dd0ac14d02a2db2bee6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:24,657 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/.tmp/f2/cd6a0ab10230423c806034795eed6424 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/cd6a0ab10230423c806034795eed6424 2023-02-14 11:02:24,657 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/.tmp/f2/0d0598a76039437dbb6d13afe5ee5e5c as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/0d0598a76039437dbb6d13afe5ee5e5c 2023-02-14 11:02:24,661 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/cd6a0ab10230423c806034795eed6424, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:02:24,662 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d7cc1d2fd940e022c086ab65d19763a0 in 190ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:24,662 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d7cc1d2fd940e022c086ab65d19763a0: 2023-02-14 11:02:24,663 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,663 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:24,663 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/3e728129848c4d04a8bcaa79520fe628] hfiles 2023-02-14 11:02:24,663 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/3e728129848c4d04a8bcaa79520fe628 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,663 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/cd6a0ab10230423c806034795eed6424] hfiles 2023-02-14 11:02:24,663 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/cd6a0ab10230423c806034795eed6424 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,664 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. completed. 2023-02-14 11:02:24,664 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:24,664 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-14 11:02:24,670 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/0d0598a76039437dbb6d13afe5ee5e5c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:24,671 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 995fffd3a5c23e591215d7a97da978d1 in 198ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:24,671 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 995fffd3a5c23e591215d7a97da978d1: 2023-02-14 11:02:24,671 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,671 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:24,671 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/d0d43c7254054dd0ac14d02a2db2bee6] hfiles 2023-02-14 11:02:24,671 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/d0d43c7254054dd0ac14d02a2db2bee6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,671 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/0d0598a76039437dbb6d13afe5ee5e5c] hfiles 2023-02-14 11:02:24,671 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/0d0598a76039437dbb6d13afe5ee5e5c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,672 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. completed. 2023-02-14 11:02:24,672 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:24,672 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:24,672 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-14 11:02:24,672 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. started... 2023-02-14 11:02:24,674 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b60430326013b2911b9ad16f73387051 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-14 11:02:24,690 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. completed. 2023-02-14 11:02:24,690 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:24,690 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:24,690 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-14 11:02:24,691 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. started... 2023-02-14 11:02:24,692 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 479b6d884849ef224df69ab884ab6a08 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-14 11:02:24,698 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/.tmp/f1/351895080b2248cc8218a8af2701e6d5 2023-02-14 11:02:24,710 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/.tmp/f1/b9728e1444c147fab76f3b5b47e18bc3 2023-02-14 11:02:24,717 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/.tmp/f2/da1cbd5cff7f4ffcafe5082a400b0f15 2023-02-14 11:02:24,722 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/.tmp/f1/351895080b2248cc8218a8af2701e6d5 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/351895080b2248cc8218a8af2701e6d5 2023-02-14 11:02:24,729 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/351895080b2248cc8218a8af2701e6d5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:02:24,729 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/.tmp/f2/da1cbd5cff7f4ffcafe5082a400b0f15 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/da1cbd5cff7f4ffcafe5082a400b0f15 2023-02-14 11:02:24,732 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/.tmp/f2/f272fde47cdf43c9b77e6f631f860056 2023-02-14 11:02:24,735 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:24,736 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/da1cbd5cff7f4ffcafe5082a400b0f15, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-14 11:02:24,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-14 11:02:24,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:24,737 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-14 11:02:24,737 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b60430326013b2911b9ad16f73387051 in 63ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:24,737 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b60430326013b2911b9ad16f73387051: 2023-02-14 11:02:24,737 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/.tmp/f1/b9728e1444c147fab76f3b5b47e18bc3 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/b9728e1444c147fab76f3b5b47e18bc3 2023-02-14 11:02:24,737 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,738 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:24,738 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/351895080b2248cc8218a8af2701e6d5] hfiles 2023-02-14 11:02:24,738 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/351895080b2248cc8218a8af2701e6d5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,738 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/da1cbd5cff7f4ffcafe5082a400b0f15] hfiles 2023-02-14 11:02:24,738 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/da1cbd5cff7f4ffcafe5082a400b0f15 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,742 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/b9728e1444c147fab76f3b5b47e18bc3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:24,743 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/.tmp/f2/f272fde47cdf43c9b77e6f631f860056 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/f272fde47cdf43c9b77e6f631f860056 2023-02-14 11:02:24,747 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/f272fde47cdf43c9b77e6f631f860056, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:24,747 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 479b6d884849ef224df69ab884ab6a08 in 55ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:24,747 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 479b6d884849ef224df69ab884ab6a08: 2023-02-14 11:02:24,748 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,748 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:24,748 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/b9728e1444c147fab76f3b5b47e18bc3] hfiles 2023-02-14 11:02:24,748 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/b9728e1444c147fab76f3b5b47e18bc3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,748 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/f272fde47cdf43c9b77e6f631f860056] hfiles 2023-02-14 11:02:24,748 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/f272fde47cdf43c9b77e6f631f860056 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:24,756 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. completed. 2023-02-14 11:02:24,756 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:24,756 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-14 11:02:24,762 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. completed. 2023-02-14 11:02:24,762 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:24,762 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-14 11:02:25,037 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:25,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-14 11:02:25,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:25,039 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-14 11:02:25,045 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/.tmp/f2/c45589fc63a24957a1ea51cab561155b 2023-02-14 11:02:25,049 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/.tmp/f2/325a5ba783bf449fa884f9c650237097 2023-02-14 11:02:25,050 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/.tmp/f1/a6291a22e00a44efaeaa96fb952f0245 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/a6291a22e00a44efaeaa96fb952f0245 2023-02-14 11:02:25,056 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/a6291a22e00a44efaeaa96fb952f0245, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:25,056 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/.tmp/f1/f2481802d9ee41828735ae6462d13ba6 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/f2481802d9ee41828735ae6462d13ba6 2023-02-14 11:02:25,057 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/.tmp/f2/c45589fc63a24957a1ea51cab561155b as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/c45589fc63a24957a1ea51cab561155b 2023-02-14 11:02:25,060 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/f2481802d9ee41828735ae6462d13ba6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:25,061 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/.tmp/f2/325a5ba783bf449fa884f9c650237097 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/325a5ba783bf449fa884f9c650237097 2023-02-14 11:02:25,061 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/c45589fc63a24957a1ea51cab561155b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:25,062 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d48fba694cc4111247235c15bb0d20bf in 555ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:25,062 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d48fba694cc4111247235c15bb0d20bf: 2023-02-14 11:02:25,062 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,063 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:25,063 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/a6291a22e00a44efaeaa96fb952f0245] hfiles 2023-02-14 11:02:25,063 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/a6291a22e00a44efaeaa96fb952f0245 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,063 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/c45589fc63a24957a1ea51cab561155b] hfiles 2023-02-14 11:02:25,063 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/c45589fc63a24957a1ea51cab561155b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,069 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/325a5ba783bf449fa884f9c650237097, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-14 11:02:25,070 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e2ffb9a970fd073a9759e7c9eec1df7a in 569ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:25,070 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e2ffb9a970fd073a9759e7c9eec1df7a: 2023-02-14 11:02:25,071 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,071 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:25,071 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/f2481802d9ee41828735ae6462d13ba6] hfiles 2023-02-14 11:02:25,071 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/f2481802d9ee41828735ae6462d13ba6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,071 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/325a5ba783bf449fa884f9c650237097] hfiles 2023-02-14 11:02:25,071 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/325a5ba783bf449fa884f9c650237097 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,078 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. completed. 2023-02-14 11:02:25,078 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:25,078 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-14 11:02:25,081 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. completed. 2023-02-14 11:02:25,081 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:25,081 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-14 11:02:25,081 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-14 11:02:25,081 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,081 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-14 11:02:25,081 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34865,1676372542472' in zk 2023-02-14 11:02:25,083 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,083 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-14 11:02:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:25,083 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:25,083 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-14 11:02:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:25,084 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. completed. 2023-02-14 11:02:25,084 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:25,084 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-14 11:02:25,084 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-14 11:02:25,084 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,084 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-14 11:02:25,084 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36945,1676372542508' in zk 2023-02-14 11:02:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,087 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,087 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-14 11:02:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,087 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:25,087 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-14 11:02:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:25,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34865,1676372542472': 2023-02-14 11:02:25,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34865,1676372542472' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-14 11:02:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:25,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:25,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36945,1676372542508': 2023-02-14 11:02:25,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36945,1676372542508' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-14 11:02:25,092 INFO [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-14 11:02:25,092 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:25,092 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:25,092 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,092 INFO [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-14 11:02:25,094 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,094 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,094 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:25,094 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,094 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:25,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:25,094 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:25,094 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,096 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,096 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,103 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,103 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:25,103 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:25,103 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:25,103 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:25,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:25,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:25,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:25,103 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,103 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,104 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,104 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,103 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:25,104 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:25,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:25,103 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:25,104 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:25,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:25,104 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,104 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-14 11:02:25,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,169 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676372544432Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676372545104 (+672 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676372545104Writing data manifest for testWithMockedMapReduceMultiRegion at 1676372545121 (+17 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676372545132 (+11 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676372545168 (+36 ms) 2023-02-14 11:02:25,170 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-14 11:02:25,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 738 msec 2023-02-14 11:02:25,539 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:25,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-14 11:02:25,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-14 11:02:25,541 INFO [Listener at localhost/38713] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-14 11:02:25,545 INFO [Listener at localhost/38713] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-14 11:02:25,550 INFO [Listener at localhost/38713] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-14 11:02:25,573 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36945] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:25,580 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34865] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:25,650 INFO [Listener at localhost/38713] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-14 11:02:25,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-14 11:02:25,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,659 INFO [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-14 11:02:25,659 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:25,660 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-14 11:02:25,660 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-14 11:02:25,661 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,661 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,662 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:25,662 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:25,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:25,662 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:25,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:25,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:25,662 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,662 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,663 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:25,663 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:25,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:25,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,663 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:25,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,664 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,664 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-14 11:02:25,664 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:25,664 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-14 11:02:25,664 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-14 11:02:25,665 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:25,665 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-14 11:02:25,665 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:25,665 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. started... 2023-02-14 11:02:25,665 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:25,665 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8355f8ee1888a80f5a9e75984303dbba 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:25,665 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. started... 2023-02-14 11:02:25,666 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d7cc1d2fd940e022c086ab65d19763a0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-14 11:02:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-14 11:02:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:25,666 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:25,666 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:25,666 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. started... 2023-02-14 11:02:25,666 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-14 11:02:25,666 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:25,666 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. started... 2023-02-14 11:02:25,667 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. started... 2023-02-14 11:02:25,667 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 87ac88c2c3ae013a48660aaeb7fb5d1f: 2023-02-14 11:02:25,667 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:25,666 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:25,667 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7c21ca5b583a87d0af772952445db929 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:25,666 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. started... 2023-02-14 11:02:25,666 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 995fffd3a5c23e591215d7a97da978d1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:25,667 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3928dba47559f8475d4b79a057a785e9: 2023-02-14 11:02:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-14 11:02:25,667 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:25,667 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:25,667 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-14 11:02:25,667 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. started... 2023-02-14 11:02:25,668 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e2ffb9a970fd073a9759e7c9eec1df7a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:25,667 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:25,668 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. started... 2023-02-14 11:02:25,668 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d48fba694cc4111247235c15bb0d20bf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:25,700 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/.tmp/f1/0fb9d9d7b36f4b42b4078b326aca278a 2023-02-14 11:02:25,704 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/.tmp/f1/4bec29ff541e46a78f3416bacd7e605b 2023-02-14 11:02:25,704 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/.tmp/f1/f74cfd95f243436b88bf05047032773e 2023-02-14 11:02:25,705 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/.tmp/f1/04d3dcc82de643319c3f6eeb7e1af916 2023-02-14 11:02:25,706 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/.tmp/f1/2df8e9cce2f74b05a45309e5b1679aac 2023-02-14 11:02:25,706 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/.tmp/f1/1d6ceed76dfd41c2bc149693fc46f604 2023-02-14 11:02:25,744 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/.tmp/f2/90e8570b0ff5401786413271f883fc83 2023-02-14 11:02:25,747 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/.tmp/f2/2c072191fb4145f9a4c03383476dd4ca 2023-02-14 11:02:25,750 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/.tmp/f1/0fb9d9d7b36f4b42b4078b326aca278a as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/0fb9d9d7b36f4b42b4078b326aca278a 2023-02-14 11:02:25,752 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/.tmp/f1/2df8e9cce2f74b05a45309e5b1679aac as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/2df8e9cce2f74b05a45309e5b1679aac 2023-02-14 11:02:25,755 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/0fb9d9d7b36f4b42b4078b326aca278a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:25,756 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/.tmp/f2/e9550d1309144f12968d50ce40082409 2023-02-14 11:02:25,756 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/.tmp/f2/90e8570b0ff5401786413271f883fc83 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/90e8570b0ff5401786413271f883fc83 2023-02-14 11:02:25,757 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/2df8e9cce2f74b05a45309e5b1679aac, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,758 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/.tmp/f2/2c072191fb4145f9a4c03383476dd4ca as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/2c072191fb4145f9a4c03383476dd4ca 2023-02-14 11:02:25,759 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/.tmp/f2/26fc2a90de084384adc66cb544a1862d 2023-02-14 11:02:25,762 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/.tmp/f1/04d3dcc82de643319c3f6eeb7e1af916 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/04d3dcc82de643319c3f6eeb7e1af916 2023-02-14 11:02:25,762 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/90e8570b0ff5401786413271f883fc83, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:25,763 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d7cc1d2fd940e022c086ab65d19763a0 in 97ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:25,763 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d7cc1d2fd940e022c086ab65d19763a0: 2023-02-14 11:02:25,763 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:25,764 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/2c072191fb4145f9a4c03383476dd4ca, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,765 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 995fffd3a5c23e591215d7a97da978d1 in 99ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:25,765 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 995fffd3a5c23e591215d7a97da978d1: 2023-02-14 11:02:25,765 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/.tmp/f1/1d6ceed76dfd41c2bc149693fc46f604 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/1d6ceed76dfd41c2bc149693fc46f604 2023-02-14 11:02:25,765 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:25,765 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:25,765 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. started... 2023-02-14 11:02:25,765 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b60430326013b2911b9ad16f73387051 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-14 11:02:25,766 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/04d3dcc82de643319c3f6eeb7e1af916, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,767 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/.tmp/f2/e9550d1309144f12968d50ce40082409 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/e9550d1309144f12968d50ce40082409 2023-02-14 11:02:25,769 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:25,769 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-14 11:02:25,769 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-14 11:02:25,769 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/.tmp/f2/7d59c36a19b241ee8110b27f4865155c 2023-02-14 11:02:25,769 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. started... 2023-02-14 11:02:25,769 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 479b6d884849ef224df69ab884ab6a08 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-14 11:02:25,771 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/1d6ceed76dfd41c2bc149693fc46f604, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,772 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/.tmp/f2/26fc2a90de084384adc66cb544a1862d as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/26fc2a90de084384adc66cb544a1862d 2023-02-14 11:02:25,774 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/e9550d1309144f12968d50ce40082409, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,775 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/.tmp/f2/e44a6e9edfee4799b2b9d1843e5b3c05 2023-02-14 11:02:25,775 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7c21ca5b583a87d0af772952445db929 in 108ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:25,775 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7c21ca5b583a87d0af772952445db929: 2023-02-14 11:02:25,775 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:25,775 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-14 11:02:25,776 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/.tmp/f1/4bec29ff541e46a78f3416bacd7e605b as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/4bec29ff541e46a78f3416bacd7e605b 2023-02-14 11:02:25,780 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/26fc2a90de084384adc66cb544a1862d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,781 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d48fba694cc4111247235c15bb0d20bf in 113ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:25,781 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d48fba694cc4111247235c15bb0d20bf: 2023-02-14 11:02:25,781 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:25,781 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-14 11:02:25,783 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/4bec29ff541e46a78f3416bacd7e605b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,785 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/.tmp/f1/81e68a4298954fe7970fbe07d812b879 2023-02-14 11:02:25,785 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/.tmp/f2/7d59c36a19b241ee8110b27f4865155c as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/7d59c36a19b241ee8110b27f4865155c 2023-02-14 11:02:25,785 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/.tmp/f1/f74cfd95f243436b88bf05047032773e as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/f74cfd95f243436b88bf05047032773e 2023-02-14 11:02:25,798 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/f74cfd95f243436b88bf05047032773e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,799 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/.tmp/f2/e44a6e9edfee4799b2b9d1843e5b3c05 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/e44a6e9edfee4799b2b9d1843e5b3c05 2023-02-14 11:02:25,800 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/7d59c36a19b241ee8110b27f4865155c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,801 INFO [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e2ffb9a970fd073a9759e7c9eec1df7a in 133ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:25,801 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e2ffb9a970fd073a9759e7c9eec1df7a: 2023-02-14 11:02:25,801 DEBUG [rs(jenkins-hbase4.apache.org,36945,1676372542508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:25,801 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-14 11:02:25,801 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-14 11:02:25,801 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,801 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-14 11:02:25,801 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36945,1676372542508' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-14 11:02:25,803 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,803 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:25,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:25,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:25,804 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,804 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:25,804 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/e44a6e9edfee4799b2b9d1843e5b3c05, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:25,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:25,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:25,805 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8355f8ee1888a80f5a9e75984303dbba in 140ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:25,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:25,805 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8355f8ee1888a80f5a9e75984303dbba: 2023-02-14 11:02:25,805 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:25,805 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-14 11:02:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:25,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36945,1676372542508' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-14 11:02:25,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@453d0c2e[Count = 1] remaining members to acquire global barrier 2023-02-14 11:02:25,811 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/.tmp/f2/9d249d6ac13e4ade8af9aceaaa614b24 2023-02-14 11:02:25,815 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/.tmp/f1/81e68a4298954fe7970fbe07d812b879 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/81e68a4298954fe7970fbe07d812b879 2023-02-14 11:02:25,818 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/81e68a4298954fe7970fbe07d812b879, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:25,819 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/.tmp/f2/9d249d6ac13e4ade8af9aceaaa614b24 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/9d249d6ac13e4ade8af9aceaaa614b24 2023-02-14 11:02:25,825 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/9d249d6ac13e4ade8af9aceaaa614b24, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-14 11:02:25,825 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b60430326013b2911b9ad16f73387051 in 60ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:25,826 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b60430326013b2911b9ad16f73387051: 2023-02-14 11:02:25,826 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:25,826 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-14 11:02:26,196 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/.tmp/f1/841b9c2a234e4136bf869e1d0058f7e2 2023-02-14 11:02:26,214 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/.tmp/f2/a07388b96efa4fcc96075f604c089341 2023-02-14 11:02:26,219 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/.tmp/f1/841b9c2a234e4136bf869e1d0058f7e2 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/841b9c2a234e4136bf869e1d0058f7e2 2023-02-14 11:02:26,224 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/841b9c2a234e4136bf869e1d0058f7e2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:26,225 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/.tmp/f2/a07388b96efa4fcc96075f604c089341 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/a07388b96efa4fcc96075f604c089341 2023-02-14 11:02:26,229 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/a07388b96efa4fcc96075f604c089341, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-14 11:02:26,229 INFO [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 479b6d884849ef224df69ab884ab6a08 in 460ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:26,230 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 479b6d884849ef224df69ab884ab6a08: 2023-02-14 11:02:26,230 DEBUG [rs(jenkins-hbase4.apache.org,34865,1676372542472)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-14 11:02:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-14 11:02:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-14 11:02:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34865,1676372542472' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-14 11:02:26,232 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,232 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:26,232 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,232 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:26,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34865,1676372542472' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-14 11:02:26,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@453d0c2e[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:26,234 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-14 11:02:26,234 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,235 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,235 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-14 11:02:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-14 11:02:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-14 11:02:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-14 11:02:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36945,1676372542508' in zk 2023-02-14 11:02:26,235 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34865,1676372542472' in zk 2023-02-14 11:02:26,236 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,236 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:26,237 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-14 11:02:26,237 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:26,237 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,237 DEBUG [member: 'jenkins-hbase4.apache.org,36945,1676372542508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-14 11:02:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:26,237 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,237 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-14 11:02:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:26,237 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:26,238 DEBUG [member: 'jenkins-hbase4.apache.org,34865,1676372542472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-14 11:02:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36945,1676372542508': 2023-02-14 11:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36945,1676372542508' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-14 11:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34865,1676372542472': 2023-02-14 11:02:26,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34865,1676372542472' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-14 11:02:26,242 INFO [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-14 11:02:26,242 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:26,242 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:26,242 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,242 INFO [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-14 11:02:26,245 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,245 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,245 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:26,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,245 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,245 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:26,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:26,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:26,246 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,246 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:26,247 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,248 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,250 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,250 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:26,250 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:26,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:26,250 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:26,250 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:26,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-14 11:02:26,250 DEBUG [(jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:26,250 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:26,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:26,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-14 11:02:26,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:26,250 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:26,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:26,250 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,251 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:26,251 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,251 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:26,251 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,251 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,251 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:26,251 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-14 11:02:26,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:26,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:26,351 DEBUG [Listener at localhost/38713] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-14 11:02:26,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-14 11:02:26,357 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676372544417 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:26,357 DEBUG [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: b60430326013b2911b9ad16f73387051 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(239): region to add: d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=8355f8ee1888a80f5a9e75984303dbba as 8355f8ee1888a80f5a9e75984303dbba in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=87ac88c2c3ae013a48660aaeb7fb5d1f as 87ac88c2c3ae013a48660aaeb7fb5d1f in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=3928dba47559f8475d4b79a057a785e9 as 3928dba47559f8475d4b79a057a785e9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=7c21ca5b583a87d0af772952445db929 as 7c21ca5b583a87d0af772952445db929 in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=d7cc1d2fd940e022c086ab65d19763a0 as d7cc1d2fd940e022c086ab65d19763a0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=995fffd3a5c23e591215d7a97da978d1 as 995fffd3a5c23e591215d7a97da978d1 in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=b60430326013b2911b9ad16f73387051 as b60430326013b2911b9ad16f73387051 in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=e2ffb9a970fd073a9759e7c9eec1df7a as e2ffb9a970fd073a9759e7c9eec1df7a in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=479b6d884849ef224df69ab884ab6a08 as 479b6d884849ef224df69ab884ab6a08 in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,358 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(585): clone region=d48fba694cc4111247235c15bb0d20bf as d48fba694cc4111247235c15bb0d20bf in snapshot testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,360 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8355f8ee1888a80f5a9e75984303dbba, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,360 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => b60430326013b2911b9ad16f73387051, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,360 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d7cc1d2fd940e022c086ab65d19763a0, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,360 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 7c21ca5b583a87d0af772952445db929, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,361 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3928dba47559f8475d4b79a057a785e9, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,361 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 87ac88c2c3ae013a48660aaeb7fb5d1f, NAME => 'testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,361 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => e2ffb9a970fd073a9759e7c9eec1df7a, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,361 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 995fffd3a5c23e591215d7a97da978d1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,396 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,396 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2a13e5f459664938839c375b8d1e51ab from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,403 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,403 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,403 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f2481802d9ee41828735ae6462d13ba6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,404 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3e728129848c4d04a8bcaa79520fe628 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,412 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cd6a0ab10230423c806034795eed6424 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,413 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d09942b31d5f45a3b251568455cf420d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,413 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,413 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 3928dba47559f8475d4b79a057a785e9, disabling compactions & flushes 2023-02-14 11:02:26,413 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:26,413 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:26,413 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. after waiting 0 ms 2023-02-14 11:02:26,413 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:26,414 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:26,414 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 3928dba47559f8475d4b79a057a785e9: 2023-02-14 11:02:26,414 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 325a5ba783bf449fa884f9c650237097 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,414 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 479b6d884849ef224df69ab884ab6a08, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,416 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,416 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 87ac88c2c3ae013a48660aaeb7fb5d1f, disabling compactions & flushes 2023-02-14 11:02:26,416 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:26,416 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:26,416 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. after waiting 0 ms 2023-02-14 11:02:26,416 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:26,416 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:26,416 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 87ac88c2c3ae013a48660aaeb7fb5d1f: 2023-02-14 11:02:26,416 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,417 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => d48fba694cc4111247235c15bb0d20bf, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,417 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 77ea7ea4ead14976b0a2bb08b3938b44 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,423 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 7c21ca5b583a87d0af772952445db929, disabling compactions & flushes 2023-02-14 11:02:26,423 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:26,423 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:26,424 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. after waiting 0 ms 2023-02-14 11:02:26,424 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:26,424 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:26,424 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 7c21ca5b583a87d0af772952445db929: 2023-02-14 11:02:26,424 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,424 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 351895080b2248cc8218a8af2701e6d5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,424 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,424 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d0d43c7254054dd0ac14d02a2db2bee6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d7cc1d2fd940e022c086ab65d19763a0, disabling compactions & flushes 2023-02-14 11:02:26,425 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:26,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:26,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. after waiting 0 ms 2023-02-14 11:02:26,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:26,425 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:26,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d7cc1d2fd940e022c086ab65d19763a0: 2023-02-14 11:02:26,426 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing e2ffb9a970fd073a9759e7c9eec1df7a, disabling compactions & flushes 2023-02-14 11:02:26,426 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:26,426 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:26,426 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. after waiting 0 ms 2023-02-14 11:02:26,426 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:26,426 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:26,426 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for e2ffb9a970fd073a9759e7c9eec1df7a: 2023-02-14 11:02:26,433 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0d0598a76039437dbb6d13afe5ee5e5c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,433 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 66eaa3d198f84d4e8e6712027dc6580d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,434 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink da1cbd5cff7f4ffcafe5082a400b0f15 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,440 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 8355f8ee1888a80f5a9e75984303dbba, disabling compactions & flushes 2023-02-14 11:02:26,440 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:26,440 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,440 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 995fffd3a5c23e591215d7a97da978d1, disabling compactions & flushes 2023-02-14 11:02:26,440 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b9728e1444c147fab76f3b5b47e18bc3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,440 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:26,440 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. after waiting 0 ms 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. after waiting 0 ms 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:26,441 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing b60430326013b2911b9ad16f73387051, disabling compactions & flushes 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 8355f8ee1888a80f5a9e75984303dbba: 2023-02-14 11:02:26,441 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:26,441 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. after waiting 0 ms 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:26,441 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 995fffd3a5c23e591215d7a97da978d1: 2023-02-14 11:02:26,441 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for b60430326013b2911b9ad16f73387051: 2023-02-14 11:02:26,442 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:26,443 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a6291a22e00a44efaeaa96fb952f0245 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,443 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f272fde47cdf43c9b77e6f631f860056 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,444 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c45589fc63a24957a1ea51cab561155b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:26,445 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 479b6d884849ef224df69ab884ab6a08, disabling compactions & flushes 2023-02-14 11:02:26,445 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:26,445 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:26,445 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. after waiting 0 ms 2023-02-14 11:02:26,445 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:26,445 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:26,445 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 479b6d884849ef224df69ab884ab6a08: 2023-02-14 11:02:26,446 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing d48fba694cc4111247235c15bb0d20bf, disabling compactions & flushes 2023-02-14 11:02:26,446 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:26,446 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:26,447 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. after waiting 0 ms 2023-02-14 11:02:26,447 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:26,447 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:26,447 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for d48fba694cc4111247235c15bb0d20bf: 2023-02-14 11:02:26,447 INFO [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676372544417 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:26,447 DEBUG [Listener at localhost/38713] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,447 DEBUG [Listener at localhost/38713] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571 2023-02-14 11:02:26,448 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-data/ 2023-02-14 11:02:26,448 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----default/ 2023-02-14 11:02:26,448 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-14 11:02:26,449 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------3928dba47559f8475d4b79a057a785e9/ 2023-02-14 11:02:26,449 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,449 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------479b6d884849ef224df69ab884ab6a08/ 2023-02-14 11:02:26,449 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,450 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:26,450 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=479b6d884849ef224df69ab884ab6a08-b9728e1444c147fab76f3b5b47e18bc3 2023-02-14 11:02:26,450 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:26,450 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=479b6d884849ef224df69ab884ab6a08-f272fde47cdf43c9b77e6f631f860056 2023-02-14 11:02:26,450 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------7c21ca5b583a87d0af772952445db929/ 2023-02-14 11:02:26,451 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,451 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:26,451 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7c21ca5b583a87d0af772952445db929-2a13e5f459664938839c375b8d1e51ab 2023-02-14 11:02:26,451 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:26,451 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7c21ca5b583a87d0af772952445db929-d09942b31d5f45a3b251568455cf420d 2023-02-14 11:02:26,451 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------8355f8ee1888a80f5a9e75984303dbba/ 2023-02-14 11:02:26,452 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,452 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:26,452 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8355f8ee1888a80f5a9e75984303dbba-77ea7ea4ead14976b0a2bb08b3938b44 2023-02-14 11:02:26,452 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:26,452 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8355f8ee1888a80f5a9e75984303dbba-66eaa3d198f84d4e8e6712027dc6580d 2023-02-14 11:02:26,452 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------87ac88c2c3ae013a48660aaeb7fb5d1f/ 2023-02-14 11:02:26,453 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,453 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------995fffd3a5c23e591215d7a97da978d1/ 2023-02-14 11:02:26,453 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,453 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:26,453 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=995fffd3a5c23e591215d7a97da978d1-d0d43c7254054dd0ac14d02a2db2bee6 2023-02-14 11:02:26,453 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:26,454 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=995fffd3a5c23e591215d7a97da978d1-0d0598a76039437dbb6d13afe5ee5e5c 2023-02-14 11:02:26,454 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------b60430326013b2911b9ad16f73387051/ 2023-02-14 11:02:26,454 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,454 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:26,454 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b60430326013b2911b9ad16f73387051-351895080b2248cc8218a8af2701e6d5 2023-02-14 11:02:26,454 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:26,455 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b60430326013b2911b9ad16f73387051-da1cbd5cff7f4ffcafe5082a400b0f15 2023-02-14 11:02:26,455 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------d48fba694cc4111247235c15bb0d20bf/ 2023-02-14 11:02:26,455 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,455 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:26,455 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d48fba694cc4111247235c15bb0d20bf-a6291a22e00a44efaeaa96fb952f0245 2023-02-14 11:02:26,456 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:26,456 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d48fba694cc4111247235c15bb0d20bf-c45589fc63a24957a1ea51cab561155b 2023-02-14 11:02:26,456 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------d7cc1d2fd940e022c086ab65d19763a0/ 2023-02-14 11:02:26,456 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,456 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:26,456 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d7cc1d2fd940e022c086ab65d19763a0-3e728129848c4d04a8bcaa79520fe628 2023-02-14 11:02:26,457 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:26,457 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d7cc1d2fd940e022c086ab65d19763a0-cd6a0ab10230423c806034795eed6424 2023-02-14 11:02:26,457 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |----------e2ffb9a970fd073a9759e7c9eec1df7a/ 2023-02-14 11:02:26,457 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:26,457 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:26,458 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e2ffb9a970fd073a9759e7c9eec1df7a-f2481802d9ee41828735ae6462d13ba6 2023-02-14 11:02:26,458 DEBUG [Listener at localhost/38713] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:26,458 DEBUG [Listener at localhost/38713] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e2ffb9a970fd073a9759e7c9eec1df7a-325a5ba783bf449fa884f9c650237097 2023-02-14 11:02:26,461 INFO [Listener at localhost/38713] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-14 11:02:27,086 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,086 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,088 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,090 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:27,091 DEBUG [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1 2023-02-14 11:02:27,091 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 479b6d884849ef224df69ab884ab6a08 columnFamilyName f1 2023-02-14 11:02:27,096 DEBUG [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/testWithMockedMapReduceMultiRegion=479b6d884849ef224df69ab884ab6a08-b9728e1444c147fab76f3b5b47e18bc3 2023-02-14 11:02:27,096 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(310): Store=479b6d884849ef224df69ab884ab6a08/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,096 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:27,097 DEBUG [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2 2023-02-14 11:02:27,097 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 479b6d884849ef224df69ab884ab6a08 columnFamilyName f2 2023-02-14 11:02:27,100 DEBUG [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/testWithMockedMapReduceMultiRegion=479b6d884849ef224df69ab884ab6a08-f272fde47cdf43c9b77e6f631f860056 2023-02-14 11:02:27,100 INFO [StoreOpener-479b6d884849ef224df69ab884ab6a08-1] regionserver.HStore(310): Store=479b6d884849ef224df69ab884ab6a08/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,101 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,101 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened 479b6d884849ef224df69ab884ab6a08; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59418568, jitterRate=-0.11459434032440186}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,101 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for 479b6d884849ef224df69ab884ab6a08: 2023-02-14 11:02:27,113 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing 479b6d884849ef224df69ab884ab6a08, disabling compactions & flushes 2023-02-14 11:02:27,114 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:27,114 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:27,114 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. after waiting 0 ms 2023-02-14 11:02:27,114 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:27,115 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:27,115 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for 479b6d884849ef224df69ab884ab6a08: 2023-02-14 11:02:27,116 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,116 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,121 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,122 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:27,124 DEBUG [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/f1 2023-02-14 11:02:27,124 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3928dba47559f8475d4b79a057a785e9 columnFamilyName f1 2023-02-14 11:02:27,125 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] regionserver.HStore(310): Store=3928dba47559f8475d4b79a057a785e9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,125 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:27,126 DEBUG [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/f2 2023-02-14 11:02:27,126 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3928dba47559f8475d4b79a057a785e9 columnFamilyName f2 2023-02-14 11:02:27,126 INFO [StoreOpener-3928dba47559f8475d4b79a057a785e9-1] regionserver.HStore(310): Store=3928dba47559f8475d4b79a057a785e9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,127 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,127 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened 3928dba47559f8475d4b79a057a785e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71679913, jitterRate=0.06811393797397614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,127 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for 3928dba47559f8475d4b79a057a785e9: 2023-02-14 11:02:27,127 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing 3928dba47559f8475d4b79a057a785e9, disabling compactions & flushes 2023-02-14 11:02:27,127 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:27,127 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:27,127 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. after waiting 0 ms 2023-02-14 11:02:27,127 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:27,128 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:27,128 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for 3928dba47559f8475d4b79a057a785e9: 2023-02-14 11:02:27,128 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,128 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,130 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,131 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:27,132 DEBUG [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1 2023-02-14 11:02:27,132 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8355f8ee1888a80f5a9e75984303dbba columnFamilyName f1 2023-02-14 11:02:27,137 DEBUG [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/testWithMockedMapReduceMultiRegion=8355f8ee1888a80f5a9e75984303dbba-77ea7ea4ead14976b0a2bb08b3938b44 2023-02-14 11:02:27,137 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(310): Store=8355f8ee1888a80f5a9e75984303dbba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,137 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:27,138 DEBUG [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2 2023-02-14 11:02:27,138 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8355f8ee1888a80f5a9e75984303dbba columnFamilyName f2 2023-02-14 11:02:27,142 DEBUG [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/testWithMockedMapReduceMultiRegion=8355f8ee1888a80f5a9e75984303dbba-66eaa3d198f84d4e8e6712027dc6580d 2023-02-14 11:02:27,142 INFO [StoreOpener-8355f8ee1888a80f5a9e75984303dbba-1] regionserver.HStore(310): Store=8355f8ee1888a80f5a9e75984303dbba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,142 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,142 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened 8355f8ee1888a80f5a9e75984303dbba; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72742403, jitterRate=0.08394627273082733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,142 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for 8355f8ee1888a80f5a9e75984303dbba: 2023-02-14 11:02:27,154 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing 8355f8ee1888a80f5a9e75984303dbba, disabling compactions & flushes 2023-02-14 11:02:27,154 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:27,154 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:27,154 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. after waiting 0 ms 2023-02-14 11:02:27,154 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:27,155 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:27,155 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for 8355f8ee1888a80f5a9e75984303dbba: 2023-02-14 11:02:27,155 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,155 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,157 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,159 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:27,160 DEBUG [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1 2023-02-14 11:02:27,160 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d48fba694cc4111247235c15bb0d20bf columnFamilyName f1 2023-02-14 11:02:27,165 DEBUG [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/testWithMockedMapReduceMultiRegion=d48fba694cc4111247235c15bb0d20bf-a6291a22e00a44efaeaa96fb952f0245 2023-02-14 11:02:27,165 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(310): Store=d48fba694cc4111247235c15bb0d20bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,165 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:27,166 DEBUG [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2 2023-02-14 11:02:27,167 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d48fba694cc4111247235c15bb0d20bf columnFamilyName f2 2023-02-14 11:02:27,171 DEBUG [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/testWithMockedMapReduceMultiRegion=d48fba694cc4111247235c15bb0d20bf-c45589fc63a24957a1ea51cab561155b 2023-02-14 11:02:27,171 INFO [StoreOpener-d48fba694cc4111247235c15bb0d20bf-1] regionserver.HStore(310): Store=d48fba694cc4111247235c15bb0d20bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,171 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,171 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened d48fba694cc4111247235c15bb0d20bf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73957012, jitterRate=0.10204535722732544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,171 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for d48fba694cc4111247235c15bb0d20bf: 2023-02-14 11:02:27,186 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing d48fba694cc4111247235c15bb0d20bf, disabling compactions & flushes 2023-02-14 11:02:27,186 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:27,186 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:27,187 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. after waiting 0 ms 2023-02-14 11:02:27,187 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:27,187 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:27,187 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for d48fba694cc4111247235c15bb0d20bf: 2023-02-14 11:02:27,188 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,188 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,189 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,191 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:27,192 DEBUG [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1 2023-02-14 11:02:27,192 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 995fffd3a5c23e591215d7a97da978d1 columnFamilyName f1 2023-02-14 11:02:27,196 DEBUG [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/testWithMockedMapReduceMultiRegion=995fffd3a5c23e591215d7a97da978d1-d0d43c7254054dd0ac14d02a2db2bee6 2023-02-14 11:02:27,196 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(310): Store=995fffd3a5c23e591215d7a97da978d1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,196 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:27,197 DEBUG [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2 2023-02-14 11:02:27,197 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 995fffd3a5c23e591215d7a97da978d1 columnFamilyName f2 2023-02-14 11:02:27,201 DEBUG [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/testWithMockedMapReduceMultiRegion=995fffd3a5c23e591215d7a97da978d1-0d0598a76039437dbb6d13afe5ee5e5c 2023-02-14 11:02:27,201 INFO [StoreOpener-995fffd3a5c23e591215d7a97da978d1-1] regionserver.HStore(310): Store=995fffd3a5c23e591215d7a97da978d1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,201 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,201 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened 995fffd3a5c23e591215d7a97da978d1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73306475, jitterRate=0.09235160052776337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,201 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for 995fffd3a5c23e591215d7a97da978d1: 2023-02-14 11:02:27,210 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing 995fffd3a5c23e591215d7a97da978d1, disabling compactions & flushes 2023-02-14 11:02:27,210 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:27,210 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:27,210 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. after waiting 0 ms 2023-02-14 11:02:27,210 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:27,212 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:27,212 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for 995fffd3a5c23e591215d7a97da978d1: 2023-02-14 11:02:27,213 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,213 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,214 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,216 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b60430326013b2911b9ad16f73387051 2023-02-14 11:02:27,217 DEBUG [StoreOpener-b60430326013b2911b9ad16f73387051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1 2023-02-14 11:02:27,218 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b60430326013b2911b9ad16f73387051 columnFamilyName f1 2023-02-14 11:02:27,221 DEBUG [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/testWithMockedMapReduceMultiRegion=b60430326013b2911b9ad16f73387051-351895080b2248cc8218a8af2701e6d5 2023-02-14 11:02:27,221 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(310): Store=b60430326013b2911b9ad16f73387051/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,222 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b60430326013b2911b9ad16f73387051 2023-02-14 11:02:27,222 DEBUG [StoreOpener-b60430326013b2911b9ad16f73387051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2 2023-02-14 11:02:27,223 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b60430326013b2911b9ad16f73387051 columnFamilyName f2 2023-02-14 11:02:27,226 DEBUG [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/testWithMockedMapReduceMultiRegion=b60430326013b2911b9ad16f73387051-da1cbd5cff7f4ffcafe5082a400b0f15 2023-02-14 11:02:27,226 INFO [StoreOpener-b60430326013b2911b9ad16f73387051-1] regionserver.HStore(310): Store=b60430326013b2911b9ad16f73387051/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,227 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,227 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened b60430326013b2911b9ad16f73387051; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59091881, jitterRate=-0.11946235597133636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,227 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for b60430326013b2911b9ad16f73387051: 2023-02-14 11:02:27,242 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing b60430326013b2911b9ad16f73387051, disabling compactions & flushes 2023-02-14 11:02:27,242 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:27,242 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:27,243 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. after waiting 0 ms 2023-02-14 11:02:27,243 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:27,243 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:27,243 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for b60430326013b2911b9ad16f73387051: 2023-02-14 11:02:27,244 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,244 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,246 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,248 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:27,248 DEBUG [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1 2023-02-14 11:02:27,249 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7cc1d2fd940e022c086ab65d19763a0 columnFamilyName f1 2023-02-14 11:02:27,253 DEBUG [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/testWithMockedMapReduceMultiRegion=d7cc1d2fd940e022c086ab65d19763a0-3e728129848c4d04a8bcaa79520fe628 2023-02-14 11:02:27,253 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(310): Store=d7cc1d2fd940e022c086ab65d19763a0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,253 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:27,254 DEBUG [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2 2023-02-14 11:02:27,254 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7cc1d2fd940e022c086ab65d19763a0 columnFamilyName f2 2023-02-14 11:02:27,257 DEBUG [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/testWithMockedMapReduceMultiRegion=d7cc1d2fd940e022c086ab65d19763a0-cd6a0ab10230423c806034795eed6424 2023-02-14 11:02:27,257 INFO [StoreOpener-d7cc1d2fd940e022c086ab65d19763a0-1] regionserver.HStore(310): Store=d7cc1d2fd940e022c086ab65d19763a0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,258 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,258 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened d7cc1d2fd940e022c086ab65d19763a0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65306248, jitterRate=-0.026861071586608887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,258 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for d7cc1d2fd940e022c086ab65d19763a0: 2023-02-14 11:02:27,267 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing d7cc1d2fd940e022c086ab65d19763a0, disabling compactions & flushes 2023-02-14 11:02:27,267 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:27,267 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:27,267 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. after waiting 0 ms 2023-02-14 11:02:27,267 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:27,268 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:27,268 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for d7cc1d2fd940e022c086ab65d19763a0: 2023-02-14 11:02:27,269 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,269 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,270 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,272 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:27,272 DEBUG [StoreOpener-7c21ca5b583a87d0af772952445db929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1 2023-02-14 11:02:27,273 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c21ca5b583a87d0af772952445db929 columnFamilyName f1 2023-02-14 11:02:27,276 DEBUG [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/testWithMockedMapReduceMultiRegion=7c21ca5b583a87d0af772952445db929-2a13e5f459664938839c375b8d1e51ab 2023-02-14 11:02:27,276 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(310): Store=7c21ca5b583a87d0af772952445db929/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,276 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:27,277 DEBUG [StoreOpener-7c21ca5b583a87d0af772952445db929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2 2023-02-14 11:02:27,277 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c21ca5b583a87d0af772952445db929 columnFamilyName f2 2023-02-14 11:02:27,281 DEBUG [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/testWithMockedMapReduceMultiRegion=7c21ca5b583a87d0af772952445db929-d09942b31d5f45a3b251568455cf420d 2023-02-14 11:02:27,281 INFO [StoreOpener-7c21ca5b583a87d0af772952445db929-1] regionserver.HStore(310): Store=7c21ca5b583a87d0af772952445db929/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,281 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,282 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened 7c21ca5b583a87d0af772952445db929; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73060746, jitterRate=0.08868995308876038}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,282 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for 7c21ca5b583a87d0af772952445db929: 2023-02-14 11:02:27,289 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing 7c21ca5b583a87d0af772952445db929, disabling compactions & flushes 2023-02-14 11:02:27,289 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:27,289 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:27,290 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. after waiting 0 ms 2023-02-14 11:02:27,290 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:27,290 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:27,290 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for 7c21ca5b583a87d0af772952445db929: 2023-02-14 11:02:27,291 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,291 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,292 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,294 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:27,295 DEBUG [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1 2023-02-14 11:02:27,295 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2ffb9a970fd073a9759e7c9eec1df7a columnFamilyName f1 2023-02-14 11:02:27,299 DEBUG [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/testWithMockedMapReduceMultiRegion=e2ffb9a970fd073a9759e7c9eec1df7a-f2481802d9ee41828735ae6462d13ba6 2023-02-14 11:02:27,299 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(310): Store=e2ffb9a970fd073a9759e7c9eec1df7a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,299 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:27,300 DEBUG [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2 2023-02-14 11:02:27,300 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2ffb9a970fd073a9759e7c9eec1df7a columnFamilyName f2 2023-02-14 11:02:27,306 DEBUG [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(539): loaded hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/testWithMockedMapReduceMultiRegion=e2ffb9a970fd073a9759e7c9eec1df7a-325a5ba783bf449fa884f9c650237097 2023-02-14 11:02:27,306 INFO [StoreOpener-e2ffb9a970fd073a9759e7c9eec1df7a-1] regionserver.HStore(310): Store=e2ffb9a970fd073a9759e7c9eec1df7a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,307 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,307 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened e2ffb9a970fd073a9759e7c9eec1df7a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64914774, jitterRate=-0.032694488763809204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,307 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for e2ffb9a970fd073a9759e7c9eec1df7a: 2023-02-14 11:02:27,318 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing e2ffb9a970fd073a9759e7c9eec1df7a, disabling compactions & flushes 2023-02-14 11:02:27,318 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:27,318 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:27,318 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. after waiting 0 ms 2023-02-14 11:02:27,318 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:27,319 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:27,319 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for e2ffb9a970fd073a9759e7c9eec1df7a: 2023-02-14 11:02:27,320 DEBUG [Listener at localhost/38713] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:27,320 INFO [Listener at localhost/38713] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:27,321 DEBUG [Listener at localhost/38713] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:27,323 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:27,324 DEBUG [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/f1 2023-02-14 11:02:27,324 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ac88c2c3ae013a48660aaeb7fb5d1f columnFamilyName f1 2023-02-14 11:02:27,325 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] regionserver.HStore(310): Store=87ac88c2c3ae013a48660aaeb7fb5d1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,325 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:27,326 DEBUG [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39115/user/jenkins/test-data/84dd0c34-3ccf-c844-dc89-653f89086f2f/testWithMockedMapReduceMultiRegion/1bc51b4c-ea74-41cd-bd27-59aa0eefe571/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/f2 2023-02-14 11:02:27,326 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ac88c2c3ae013a48660aaeb7fb5d1f columnFamilyName f2 2023-02-14 11:02:27,326 INFO [StoreOpener-87ac88c2c3ae013a48660aaeb7fb5d1f-1] regionserver.HStore(310): Store=87ac88c2c3ae013a48660aaeb7fb5d1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:27,326 DEBUG [Listener at localhost/38713] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:27,326 INFO [Listener at localhost/38713] regionserver.HRegion(1071): Opened 87ac88c2c3ae013a48660aaeb7fb5d1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62516911, jitterRate=-0.06842543184757233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:27,327 DEBUG [Listener at localhost/38713] regionserver.HRegion(964): Region open journal for 87ac88c2c3ae013a48660aaeb7fb5d1f: 2023-02-14 11:02:27,327 DEBUG [Listener at localhost/38713] regionserver.HRegion(1603): Closing 87ac88c2c3ae013a48660aaeb7fb5d1f, disabling compactions & flushes 2023-02-14 11:02:27,327 INFO [Listener at localhost/38713] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:27,327 DEBUG [Listener at localhost/38713] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:27,327 DEBUG [Listener at localhost/38713] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. after waiting 0 ms 2023-02-14 11:02:27,327 DEBUG [Listener at localhost/38713] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:27,327 INFO [Listener at localhost/38713] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:27,328 DEBUG [Listener at localhost/38713] regionserver.HRegion(1557): Region close journal for 87ac88c2c3ae013a48660aaeb7fb5d1f: 2023-02-14 11:02:27,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-14 11:02:27,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,338 INFO [Listener at localhost/38713] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-14 11:02:27,341 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372547341"}]},"ts":"1676372547341"} 2023-02-14 11:02:27,342 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-14 11:02:27,343 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-14 11:02:27,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac88c2c3ae013a48660aaeb7fb5d1f, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b60430326013b2911b9ad16f73387051, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=995fffd3a5c23e591215d7a97da978d1, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c21ca5b583a87d0af772952445db929, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8355f8ee1888a80f5a9e75984303dbba, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d48fba694cc4111247235c15bb0d20bf, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2ffb9a970fd073a9759e7c9eec1df7a, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=479b6d884849ef224df69ab884ab6a08, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7cc1d2fd940e022c086ab65d19763a0, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3928dba47559f8475d4b79a057a785e9, UNASSIGN}] 2023-02-14 11:02:27,346 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b60430326013b2911b9ad16f73387051, UNASSIGN 2023-02-14 11:02:27,346 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=995fffd3a5c23e591215d7a97da978d1, UNASSIGN 2023-02-14 11:02:27,346 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c21ca5b583a87d0af772952445db929, UNASSIGN 2023-02-14 11:02:27,346 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac88c2c3ae013a48660aaeb7fb5d1f, UNASSIGN 2023-02-14 11:02:27,346 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3928dba47559f8475d4b79a057a785e9, UNASSIGN 2023-02-14 11:02:27,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=b60430326013b2911b9ad16f73387051, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:27,347 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547346"}]},"ts":"1676372547346"} 2023-02-14 11:02:27,347 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=87ac88c2c3ae013a48660aaeb7fb5d1f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:27,347 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7c21ca5b583a87d0af772952445db929, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:27,347 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372547347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547347"}]},"ts":"1676372547347"} 2023-02-14 11:02:27,347 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=995fffd3a5c23e591215d7a97da978d1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:27,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3928dba47559f8475d4b79a057a785e9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:27,347 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547347"}]},"ts":"1676372547347"} 2023-02-14 11:02:27,347 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372547347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547347"}]},"ts":"1676372547347"} 2023-02-14 11:02:27,347 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547347"}]},"ts":"1676372547347"} 2023-02-14 11:02:27,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure b60430326013b2911b9ad16f73387051, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:27,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=34, state=RUNNABLE; CloseRegionProcedure 87ac88c2c3ae013a48660aaeb7fb5d1f, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:27,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 7c21ca5b583a87d0af772952445db929, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:27,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 3928dba47559f8475d4b79a057a785e9, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:27,350 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7cc1d2fd940e022c086ab65d19763a0, UNASSIGN 2023-02-14 11:02:27,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=36, state=RUNNABLE; CloseRegionProcedure 995fffd3a5c23e591215d7a97da978d1, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:27,351 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=479b6d884849ef224df69ab884ab6a08, UNASSIGN 2023-02-14 11:02:27,351 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=d7cc1d2fd940e022c086ab65d19763a0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:27,351 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547351"}]},"ts":"1676372547351"} 2023-02-14 11:02:27,352 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2ffb9a970fd073a9759e7c9eec1df7a, UNASSIGN 2023-02-14 11:02:27,352 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=479b6d884849ef224df69ab884ab6a08, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:27,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547352"}]},"ts":"1676372547352"} 2023-02-14 11:02:27,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure d7cc1d2fd940e022c086ab65d19763a0, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:27,352 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d48fba694cc4111247235c15bb0d20bf, UNASSIGN 2023-02-14 11:02:27,353 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e2ffb9a970fd073a9759e7c9eec1df7a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:27,353 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547353"}]},"ts":"1676372547353"} 2023-02-14 11:02:27,354 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d48fba694cc4111247235c15bb0d20bf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:27,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 479b6d884849ef224df69ab884ab6a08, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:27,354 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547354"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547354"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547354"}]},"ts":"1676372547354"} 2023-02-14 11:02:27,354 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8355f8ee1888a80f5a9e75984303dbba, UNASSIGN 2023-02-14 11:02:27,355 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8355f8ee1888a80f5a9e75984303dbba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:27,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure e2ffb9a970fd073a9759e7c9eec1df7a, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:27,355 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372547355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372547355"}]},"ts":"1676372547355"} 2023-02-14 11:02:27,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure d48fba694cc4111247235c15bb0d20bf, server=jenkins-hbase4.apache.org,36945,1676372542508}] 2023-02-14 11:02:27,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 8355f8ee1888a80f5a9e75984303dbba, server=jenkins-hbase4.apache.org,34865,1676372542472}] 2023-02-14 11:02:27,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-14 11:02:27,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:27,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 995fffd3a5c23e591215d7a97da978d1, disabling compactions & flushes 2023-02-14 11:02:27,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:27,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:27,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. after waiting 0 ms 2023-02-14 11:02:27,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:27,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:27,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 87ac88c2c3ae013a48660aaeb7fb5d1f, disabling compactions & flushes 2023-02-14 11:02:27,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:27,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:27,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. after waiting 0 ms 2023-02-14 11:02:27,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:27,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:27,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-14 11:02:27,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1. 2023-02-14 11:02:27,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 995fffd3a5c23e591215d7a97da978d1: 2023-02-14 11:02:27,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f. 2023-02-14 11:02:27,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 87ac88c2c3ae013a48660aaeb7fb5d1f: 2023-02-14 11:02:27,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:27,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:27,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e2ffb9a970fd073a9759e7c9eec1df7a, disabling compactions & flushes 2023-02-14 11:02:27,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:27,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:27,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. after waiting 0 ms 2023-02-14 11:02:27,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:27,507 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=87ac88c2c3ae013a48660aaeb7fb5d1f, regionState=CLOSED 2023-02-14 11:02:27,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372547506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547506"}]},"ts":"1676372547506"} 2023-02-14 11:02:27,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:27,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:27,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8355f8ee1888a80f5a9e75984303dbba, disabling compactions & flushes 2023-02-14 11:02:27,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:27,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:27,507 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=995fffd3a5c23e591215d7a97da978d1, regionState=CLOSED 2023-02-14 11:02:27,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. after waiting 0 ms 2023-02-14 11:02:27,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:27,507 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547507"}]},"ts":"1676372547507"} 2023-02-14 11:02:27,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=34 2023-02-14 11:02:27,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=34, state=SUCCESS; CloseRegionProcedure 87ac88c2c3ae013a48660aaeb7fb5d1f, server=jenkins-hbase4.apache.org,36945,1676372542508 in 160 msec 2023-02-14 11:02:27,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=36 2023-02-14 11:02:27,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:27,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=36, state=SUCCESS; CloseRegionProcedure 995fffd3a5c23e591215d7a97da978d1, server=jenkins-hbase4.apache.org,34865,1676372542472 in 159 msec 2023-02-14 11:02:27,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:27,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a. 2023-02-14 11:02:27,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e2ffb9a970fd073a9759e7c9eec1df7a: 2023-02-14 11:02:27,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac88c2c3ae013a48660aaeb7fb5d1f, UNASSIGN in 166 msec 2023-02-14 11:02:27,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba. 2023-02-14 11:02:27,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8355f8ee1888a80f5a9e75984303dbba: 2023-02-14 11:02:27,512 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=995fffd3a5c23e591215d7a97da978d1, UNASSIGN in 167 msec 2023-02-14 11:02:27,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:27,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:27,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7c21ca5b583a87d0af772952445db929, disabling compactions & flushes 2023-02-14 11:02:27,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:27,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:27,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. after waiting 0 ms 2023-02-14 11:02:27,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:27,513 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e2ffb9a970fd073a9759e7c9eec1df7a, regionState=CLOSED 2023-02-14 11:02:27,513 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547513"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547513"}]},"ts":"1676372547513"} 2023-02-14 11:02:27,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:27,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:27,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d7cc1d2fd940e022c086ab65d19763a0, disabling compactions & flushes 2023-02-14 11:02:27,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:27,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:27,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. after waiting 0 ms 2023-02-14 11:02:27,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:27,514 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8355f8ee1888a80f5a9e75984303dbba, regionState=CLOSED 2023-02-14 11:02:27,514 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547514"}]},"ts":"1676372547514"} 2023-02-14 11:02:27,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-14 11:02:27,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure e2ffb9a970fd073a9759e7c9eec1df7a, server=jenkins-hbase4.apache.org,36945,1676372542508 in 159 msec 2023-02-14 11:02:27,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e2ffb9a970fd073a9759e7c9eec1df7a, UNASSIGN in 172 msec 2023-02-14 11:02:27,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-14 11:02:27,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 8355f8ee1888a80f5a9e75984303dbba, server=jenkins-hbase4.apache.org,34865,1676372542472 in 156 msec 2023-02-14 11:02:27,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8355f8ee1888a80f5a9e75984303dbba, UNASSIGN in 173 msec 2023-02-14 11:02:27,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:27,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929. 2023-02-14 11:02:27,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7c21ca5b583a87d0af772952445db929: 2023-02-14 11:02:27,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:27,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d48fba694cc4111247235c15bb0d20bf, disabling compactions & flushes 2023-02-14 11:02:27,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. after waiting 0 ms 2023-02-14 11:02:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:27,521 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7c21ca5b583a87d0af772952445db929, regionState=CLOSED 2023-02-14 11:02:27,521 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547521"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547521"}]},"ts":"1676372547521"} 2023-02-14 11:02:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:27,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0. 2023-02-14 11:02:27,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d7cc1d2fd940e022c086ab65d19763a0: 2023-02-14 11:02:27,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:27,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:27,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 479b6d884849ef224df69ab884ab6a08, disabling compactions & flushes 2023-02-14 11:02:27,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:27,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:27,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. after waiting 0 ms 2023-02-14 11:02:27,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:27,523 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=d7cc1d2fd940e022c086ab65d19763a0, regionState=CLOSED 2023-02-14 11:02:27,523 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547523"}]},"ts":"1676372547523"} 2023-02-14 11:02:27,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:27,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf. 2023-02-14 11:02:27,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d48fba694cc4111247235c15bb0d20bf: 2023-02-14 11:02:27,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-14 11:02:27,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 7c21ca5b583a87d0af772952445db929, server=jenkins-hbase4.apache.org,36945,1676372542508 in 173 msec 2023-02-14 11:02:27,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:27,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:27,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3928dba47559f8475d4b79a057a785e9, disabling compactions & flushes 2023-02-14 11:02:27,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7c21ca5b583a87d0af772952445db929, UNASSIGN in 182 msec 2023-02-14 11:02:27,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. after waiting 0 ms 2023-02-14 11:02:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:27,529 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d48fba694cc4111247235c15bb0d20bf, regionState=CLOSED 2023-02-14 11:02:27,529 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547529"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547529"}]},"ts":"1676372547529"} 2023-02-14 11:02:27,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-14 11:02:27,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9. 2023-02-14 11:02:27,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3928dba47559f8475d4b79a057a785e9: 2023-02-14 11:02:27,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:27,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08. 2023-02-14 11:02:27,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 479b6d884849ef224df69ab884ab6a08: 2023-02-14 11:02:27,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-14 11:02:27,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure d7cc1d2fd940e022c086ab65d19763a0, server=jenkins-hbase4.apache.org,34865,1676372542472 in 176 msec 2023-02-14 11:02:27,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:27,537 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3928dba47559f8475d4b79a057a785e9, regionState=CLOSED 2023-02-14 11:02:27,537 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676372547537"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547537"}]},"ts":"1676372547537"} 2023-02-14 11:02:27,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:27,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b60430326013b2911b9ad16f73387051 2023-02-14 11:02:27,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-14 11:02:27,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7cc1d2fd940e022c086ab65d19763a0, UNASSIGN in 192 msec 2023-02-14 11:02:27,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure d48fba694cc4111247235c15bb0d20bf, server=jenkins-hbase4.apache.org,36945,1676372542508 in 175 msec 2023-02-14 11:02:27,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b60430326013b2911b9ad16f73387051, disabling compactions & flushes 2023-02-14 11:02:27,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:27,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:27,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. after waiting 0 ms 2023-02-14 11:02:27,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:27,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=479b6d884849ef224df69ab884ab6a08, regionState=CLOSED 2023-02-14 11:02:27,538 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547538"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547538"}]},"ts":"1676372547538"} 2023-02-14 11:02:27,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d48fba694cc4111247235c15bb0d20bf, UNASSIGN in 193 msec 2023-02-14 11:02:27,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-14 11:02:27,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 3928dba47559f8475d4b79a057a785e9, server=jenkins-hbase4.apache.org,36945,1676372542508 in 188 msec 2023-02-14 11:02:27,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-14 11:02:27,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 479b6d884849ef224df69ab884ab6a08, server=jenkins-hbase4.apache.org,34865,1676372542472 in 185 msec 2023-02-14 11:02:27,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3928dba47559f8475d4b79a057a785e9, UNASSIGN in 196 msec 2023-02-14 11:02:27,542 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=479b6d884849ef224df69ab884ab6a08, UNASSIGN in 197 msec 2023-02-14 11:02:27,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:27,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051. 2023-02-14 11:02:27,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b60430326013b2911b9ad16f73387051: 2023-02-14 11:02:27,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b60430326013b2911b9ad16f73387051 2023-02-14 11:02:27,548 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=b60430326013b2911b9ad16f73387051, regionState=CLOSED 2023-02-14 11:02:27,548 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676372547548"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372547548"}]},"ts":"1676372547548"} 2023-02-14 11:02:27,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-14 11:02:27,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure b60430326013b2911b9ad16f73387051, server=jenkins-hbase4.apache.org,34865,1676372542472 in 201 msec 2023-02-14 11:02:27,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-14 11:02:27,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b60430326013b2911b9ad16f73387051, UNASSIGN in 206 msec 2023-02-14 11:02:27,552 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372547552"}]},"ts":"1676372547552"} 2023-02-14 11:02:27,553 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-14 11:02:27,555 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-14 11:02:27,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 217 msec 2023-02-14 11:02:27,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-14 11:02:27,644 INFO [Listener at localhost/38713] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-14 11:02:27,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,648 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,648 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-14 11:02:27,658 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:27,659 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:27,659 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:27,658 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051 2023-02-14 11:02:27,659 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:27,659 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:27,658 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:27,659 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:27,663 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/recovered.edits] 2023-02-14 11:02:27,663 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/recovered.edits] 2023-02-14 11:02:27,663 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/recovered.edits] 2023-02-14 11:02:27,664 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/recovered.edits] 2023-02-14 11:02:27,664 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/recovered.edits] 2023-02-14 11:02:27,664 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/recovered.edits] 2023-02-14 11:02:27,664 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/recovered.edits] 2023-02-14 11:02:27,665 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/recovered.edits] 2023-02-14 11:02:27,671 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/4bec29ff541e46a78f3416bacd7e605b to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/4bec29ff541e46a78f3416bacd7e605b 2023-02-14 11:02:27,673 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/04d3dcc82de643319c3f6eeb7e1af916 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/04d3dcc82de643319c3f6eeb7e1af916 2023-02-14 11:02:27,674 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/2df8e9cce2f74b05a45309e5b1679aac to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/2df8e9cce2f74b05a45309e5b1679aac 2023-02-14 11:02:27,674 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/841b9c2a234e4136bf869e1d0058f7e2 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/841b9c2a234e4136bf869e1d0058f7e2 2023-02-14 11:02:27,674 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/351895080b2248cc8218a8af2701e6d5 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/351895080b2248cc8218a8af2701e6d5 2023-02-14 11:02:27,674 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/1d6ceed76dfd41c2bc149693fc46f604 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/1d6ceed76dfd41c2bc149693fc46f604 2023-02-14 11:02:27,674 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/f2481802d9ee41828735ae6462d13ba6 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f1/f2481802d9ee41828735ae6462d13ba6 2023-02-14 11:02:27,675 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/77ea7ea4ead14976b0a2bb08b3938b44 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/77ea7ea4ead14976b0a2bb08b3938b44 2023-02-14 11:02:27,676 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/b9728e1444c147fab76f3b5b47e18bc3 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f1/b9728e1444c147fab76f3b5b47e18bc3 2023-02-14 11:02:27,676 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/d0d43c7254054dd0ac14d02a2db2bee6 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f1/d0d43c7254054dd0ac14d02a2db2bee6 2023-02-14 11:02:27,677 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/2a13e5f459664938839c375b8d1e51ab to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f1/2a13e5f459664938839c375b8d1e51ab 2023-02-14 11:02:27,678 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/81e68a4298954fe7970fbe07d812b879 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f1/81e68a4298954fe7970fbe07d812b879 2023-02-14 11:02:27,679 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/a6291a22e00a44efaeaa96fb952f0245 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f1/a6291a22e00a44efaeaa96fb952f0245 2023-02-14 11:02:27,679 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/f74cfd95f243436b88bf05047032773e to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f1/f74cfd95f243436b88bf05047032773e 2023-02-14 11:02:27,679 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/recovered.edits/6.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f/recovered.edits/6.seqid 2023-02-14 11:02:27,680 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac88c2c3ae013a48660aaeb7fb5d1f 2023-02-14 11:02:27,680 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:27,683 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/325a5ba783bf449fa884f9c650237097 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/325a5ba783bf449fa884f9c650237097 2023-02-14 11:02:27,683 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/0d0598a76039437dbb6d13afe5ee5e5c to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/0d0598a76039437dbb6d13afe5ee5e5c 2023-02-14 11:02:27,684 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/d09942b31d5f45a3b251568455cf420d to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/d09942b31d5f45a3b251568455cf420d 2023-02-14 11:02:27,685 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/a07388b96efa4fcc96075f604c089341 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/a07388b96efa4fcc96075f604c089341 2023-02-14 11:02:27,685 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/9d249d6ac13e4ade8af9aceaaa614b24 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/9d249d6ac13e4ade8af9aceaaa614b24 2023-02-14 11:02:27,685 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/26fc2a90de084384adc66cb544a1862d to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/26fc2a90de084384adc66cb544a1862d 2023-02-14 11:02:27,686 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/recovered.edits] 2023-02-14 11:02:27,686 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/2c072191fb4145f9a4c03383476dd4ca to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/f2/2c072191fb4145f9a4c03383476dd4ca 2023-02-14 11:02:27,686 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/7d59c36a19b241ee8110b27f4865155c to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/f2/7d59c36a19b241ee8110b27f4865155c 2023-02-14 11:02:27,686 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/e9550d1309144f12968d50ce40082409 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/f2/e9550d1309144f12968d50ce40082409 2023-02-14 11:02:27,687 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/66eaa3d198f84d4e8e6712027dc6580d to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/66eaa3d198f84d4e8e6712027dc6580d 2023-02-14 11:02:27,688 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/f272fde47cdf43c9b77e6f631f860056 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/f2/f272fde47cdf43c9b77e6f631f860056 2023-02-14 11:02:27,688 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/da1cbd5cff7f4ffcafe5082a400b0f15 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/f2/da1cbd5cff7f4ffcafe5082a400b0f15 2023-02-14 11:02:27,689 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/e44a6e9edfee4799b2b9d1843e5b3c05 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/f2/e44a6e9edfee4799b2b9d1843e5b3c05 2023-02-14 11:02:27,689 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/c45589fc63a24957a1ea51cab561155b to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/f2/c45589fc63a24957a1ea51cab561155b 2023-02-14 11:02:27,692 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/0fb9d9d7b36f4b42b4078b326aca278a to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/0fb9d9d7b36f4b42b4078b326aca278a 2023-02-14 11:02:27,693 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/recovered.edits/12.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a/recovered.edits/12.seqid 2023-02-14 11:02:27,693 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/recovered.edits/12.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1/recovered.edits/12.seqid 2023-02-14 11:02:27,693 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/recovered.edits/12.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051/recovered.edits/12.seqid 2023-02-14 11:02:27,694 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/recovered.edits/12.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929/recovered.edits/12.seqid 2023-02-14 11:02:27,694 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b60430326013b2911b9ad16f73387051 2023-02-14 11:02:27,694 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:27,695 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/995fffd3a5c23e591215d7a97da978d1 2023-02-14 11:02:27,695 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/e2ffb9a970fd073a9759e7c9eec1df7a 2023-02-14 11:02:27,695 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/recovered.edits/12.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08/recovered.edits/12.seqid 2023-02-14 11:02:27,695 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/recovered.edits/12.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba/recovered.edits/12.seqid 2023-02-14 11:02:27,696 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/3e728129848c4d04a8bcaa79520fe628 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f1/3e728129848c4d04a8bcaa79520fe628 2023-02-14 11:02:27,696 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/7c21ca5b583a87d0af772952445db929 2023-02-14 11:02:27,697 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/recovered.edits/12.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf/recovered.edits/12.seqid 2023-02-14 11:02:27,697 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/479b6d884849ef224df69ab884ab6a08 2023-02-14 11:02:27,697 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/8355f8ee1888a80f5a9e75984303dbba 2023-02-14 11:02:27,697 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d48fba694cc4111247235c15bb0d20bf 2023-02-14 11:02:27,697 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/f1, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/f2, FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/recovered.edits] 2023-02-14 11:02:27,699 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/90e8570b0ff5401786413271f883fc83 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/90e8570b0ff5401786413271f883fc83 2023-02-14 11:02:27,700 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/cd6a0ab10230423c806034795eed6424 to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/f2/cd6a0ab10230423c806034795eed6424 2023-02-14 11:02:27,702 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/recovered.edits/6.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9/recovered.edits/6.seqid 2023-02-14 11:02:27,703 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3928dba47559f8475d4b79a057a785e9 2023-02-14 11:02:27,703 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/recovered.edits/12.seqid to hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/archive/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0/recovered.edits/12.seqid 2023-02-14 11:02:27,703 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7cc1d2fd940e022c086ab65d19763a0 2023-02-14 11:02:27,703 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-14 11:02:27,705 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,709 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-14 11:02:27,711 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372547712"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,714 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-14 11:02:27,714 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87ac88c2c3ae013a48660aaeb7fb5d1f, NAME => 'testWithMockedMapReduceMultiRegion,,1676372543646.87ac88c2c3ae013a48660aaeb7fb5d1f.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => b60430326013b2911b9ad16f73387051, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676372543646.b60430326013b2911b9ad16f73387051.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 995fffd3a5c23e591215d7a97da978d1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676372543646.995fffd3a5c23e591215d7a97da978d1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 7c21ca5b583a87d0af772952445db929, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676372543646.7c21ca5b583a87d0af772952445db929.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 8355f8ee1888a80f5a9e75984303dbba, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676372543646.8355f8ee1888a80f5a9e75984303dbba.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => d48fba694cc4111247235c15bb0d20bf, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676372543646.d48fba694cc4111247235c15bb0d20bf.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => e2ffb9a970fd073a9759e7c9eec1df7a, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676372543646.e2ffb9a970fd073a9759e7c9eec1df7a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 479b6d884849ef224df69ab884ab6a08, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676372543646.479b6d884849ef224df69ab884ab6a08.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => d7cc1d2fd940e022c086ab65d19763a0, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676372543646.d7cc1d2fd940e022c086ab65d19763a0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 3928dba47559f8475d4b79a057a785e9, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676372543646.3928dba47559f8475d4b79a057a785e9.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-14 11:02:27,714 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-14 11:02:27,714 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676372547714"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:27,715 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-14 11:02:27,718 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-14 11:02:27,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 73 msec 2023-02-14 11:02:27,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35119] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-14 11:02:27,750 INFO [Listener at localhost/38713] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-14 11:02:27,750 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-14 11:02:27,751 INFO [Listener at localhost/38713] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-14 11:02:27,751 DEBUG [Listener at localhost/38713] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x521568ba to 127.0.0.1:60887 2023-02-14 11:02:27,751 DEBUG [Listener at localhost/38713] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:27,751 DEBUG [Listener at localhost/38713] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-14 11:02:27,751 DEBUG [Listener at localhost/38713] util.JVMClusterUtil(257): Found active master hash=1528189888, stopped=false 2023-02-14 11:02:27,751 INFO [Listener at localhost/38713] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:27,753 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:27,753 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:27,753 INFO [Listener at localhost/38713] procedure2.ProcedureExecutor(629): Stopping 2023-02-14 11:02:27,753 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:27,753 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:27,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:27,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:27,755 DEBUG [Listener at localhost/38713] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x178e5fa6 to 127.0.0.1:60887 2023-02-14 11:02:27,755 DEBUG [Listener at localhost/38713] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:27,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:27,755 INFO [Listener at localhost/38713] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34865,1676372542472' ***** 2023-02-14 11:02:27,755 INFO [Listener at localhost/38713] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:27,755 INFO [Listener at localhost/38713] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36945,1676372542508' ***** 2023-02-14 11:02:27,755 INFO [Listener at localhost/38713] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:27,755 INFO [RS:0;jenkins-hbase4:34865] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:27,755 INFO [RS:1;jenkins-hbase4:36945] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:27,756 INFO [RS:0;jenkins-hbase4:34865] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:27,756 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:27,756 INFO [RS:0;jenkins-hbase4:34865] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:27,756 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:27,756 INFO [RS:1;jenkins-hbase4:36945] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:27,756 INFO [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:27,756 INFO [RS:1;jenkins-hbase4:36945] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:27,757 DEBUG [RS:0;jenkins-hbase4:34865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cccd12a to 127.0.0.1:60887 2023-02-14 11:02:27,757 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(3304): Received CLOSE for 36840939277fb9e7449aad713946d91e 2023-02-14 11:02:27,757 DEBUG [RS:0;jenkins-hbase4:34865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:27,757 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:27,757 INFO [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34865,1676372542472; all regions closed. 2023-02-14 11:02:27,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 36840939277fb9e7449aad713946d91e, disabling compactions & flushes 2023-02-14 11:02:27,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:27,757 DEBUG [RS:1;jenkins-hbase4:36945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42c695a9 to 127.0.0.1:60887 2023-02-14 11:02:27,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:27,758 DEBUG [RS:1;jenkins-hbase4:36945] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:27,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. after waiting 0 ms 2023-02-14 11:02:27,758 INFO [RS:1;jenkins-hbase4:36945] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:27,758 INFO [RS:1;jenkins-hbase4:36945] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:27,758 INFO [RS:1;jenkins-hbase4:36945] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:27,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:27,758 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-14 11:02:27,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 36840939277fb9e7449aad713946d91e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-14 11:02:27,759 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-14 11:02:27,759 DEBUG [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1479): Online Regions={36840939277fb9e7449aad713946d91e=hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e., 1588230740=hbase:meta,,1.1588230740} 2023-02-14 11:02:27,759 DEBUG [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1505): Waiting on 1588230740, 36840939277fb9e7449aad713946d91e 2023-02-14 11:02:27,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:27,761 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:27,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:27,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:27,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:27,761 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-14 11:02:27,766 DEBUG [RS:0;jenkins-hbase4:34865] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/oldWALs 2023-02-14 11:02:27,766 INFO [RS:0;jenkins-hbase4:34865] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34865%2C1676372542472:(num 1676372543832) 2023-02-14 11:02:27,766 DEBUG [RS:0;jenkins-hbase4:34865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:27,766 INFO [RS:0;jenkins-hbase4:34865] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:27,766 INFO [RS:0;jenkins-hbase4:34865] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:27,766 INFO [RS:0;jenkins-hbase4:34865] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:27,766 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:27,766 INFO [RS:0;jenkins-hbase4:34865] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:27,767 INFO [RS:0;jenkins-hbase4:34865] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:27,768 INFO [RS:0;jenkins-hbase4:34865] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34865 2023-02-14 11:02:27,771 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:27,771 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:27,771 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:27,771 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34865,1676372542472 2023-02-14 11:02:27,771 ERROR [Listener at localhost/38713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7046b3df rejected from java.util.concurrent.ThreadPoolExecutor@7479290f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:27,771 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:27,771 ERROR [Listener at localhost/38713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@459d870e rejected from java.util.concurrent.ThreadPoolExecutor@7479290f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:27,772 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34865,1676372542472] 2023-02-14 11:02:27,772 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34865,1676372542472; numProcessing=1 2023-02-14 11:02:27,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e/.tmp/info/8239c66c28324f9586b10d3440e32bc0 2023-02-14 11:02:27,774 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/.tmp/info/50745ae2e610486bb2b41fc7494a42db 2023-02-14 11:02:27,775 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34865,1676372542472 already deleted, retry=false 2023-02-14 11:02:27,775 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34865,1676372542472 expired; onlineServers=1 2023-02-14 11:02:27,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50745ae2e610486bb2b41fc7494a42db 2023-02-14 11:02:27,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e/.tmp/info/8239c66c28324f9586b10d3440e32bc0 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e/info/8239c66c28324f9586b10d3440e32bc0 2023-02-14 11:02:27,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e/info/8239c66c28324f9586b10d3440e32bc0, entries=2, sequenceid=6, filesize=4.8 K 2023-02-14 11:02:27,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 36840939277fb9e7449aad713946d91e in 26ms, sequenceid=6, compaction requested=false 2023-02-14 11:02:27,795 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-14 11:02:27,795 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-14 11:02:27,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/namespace/36840939277fb9e7449aad713946d91e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-14 11:02:27,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:27,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 36840939277fb9e7449aad713946d91e: 2023-02-14 11:02:27,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676372543113.36840939277fb9e7449aad713946d91e. 2023-02-14 11:02:27,798 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/.tmp/rep_barrier/0bea027c3ad544ac967b38b4c5624b46 2023-02-14 11:02:27,800 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:27,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0bea027c3ad544ac967b38b4c5624b46 2023-02-14 11:02:27,804 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:27,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/.tmp/table/8bab216a162146cebc4cbf6b5fd4d87e 2023-02-14 11:02:27,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bab216a162146cebc4cbf6b5fd4d87e 2023-02-14 11:02:27,817 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/.tmp/info/50745ae2e610486bb2b41fc7494a42db as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/info/50745ae2e610486bb2b41fc7494a42db 2023-02-14 11:02:27,821 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50745ae2e610486bb2b41fc7494a42db 2023-02-14 11:02:27,821 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/info/50745ae2e610486bb2b41fc7494a42db, entries=30, sequenceid=57, filesize=8.3 K 2023-02-14 11:02:27,821 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/.tmp/rep_barrier/0bea027c3ad544ac967b38b4c5624b46 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/rep_barrier/0bea027c3ad544ac967b38b4c5624b46 2023-02-14 11:02:27,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0bea027c3ad544ac967b38b4c5624b46 2023-02-14 11:02:27,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/rep_barrier/0bea027c3ad544ac967b38b4c5624b46, entries=10, sequenceid=57, filesize=6.1 K 2023-02-14 11:02:27,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/.tmp/table/8bab216a162146cebc4cbf6b5fd4d87e as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/table/8bab216a162146cebc4cbf6b5fd4d87e 2023-02-14 11:02:27,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bab216a162146cebc4cbf6b5fd4d87e 2023-02-14 11:02:27,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/table/8bab216a162146cebc4cbf6b5fd4d87e, entries=13, sequenceid=57, filesize=6.1 K 2023-02-14 11:02:27,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=57, compaction requested=false 2023-02-14 11:02:27,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-14 11:02:27,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:27,834 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:27,834 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:27,834 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:27,953 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:27,953 INFO [RS:0;jenkins-hbase4:34865] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34865,1676372542472; zookeeper connection closed. 2023-02-14 11:02:27,953 ERROR [Listener at localhost/38713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d8c6c67 rejected from java.util.concurrent.ThreadPoolExecutor@7479290f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:27,953 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@199c7f41] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@199c7f41 2023-02-14 11:02:27,953 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:34865-0x100527eed850001, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:27,953 ERROR [Listener at localhost/38713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78d81e78 rejected from java.util.concurrent.ThreadPoolExecutor@7479290f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:27,959 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36945,1676372542508; all regions closed. 2023-02-14 11:02:27,963 DEBUG [RS:1;jenkins-hbase4:36945] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/oldWALs 2023-02-14 11:02:27,963 INFO [RS:1;jenkins-hbase4:36945] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36945%2C1676372542508.meta:.meta(num 1676372543051) 2023-02-14 11:02:27,966 DEBUG [RS:1;jenkins-hbase4:36945] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/oldWALs 2023-02-14 11:02:27,966 INFO [RS:1;jenkins-hbase4:36945] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36945%2C1676372542508:(num 1676372543477) 2023-02-14 11:02:27,966 DEBUG [RS:1;jenkins-hbase4:36945] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:27,966 INFO [RS:1;jenkins-hbase4:36945] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:27,966 INFO [RS:1;jenkins-hbase4:36945] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:27,966 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:27,967 INFO [RS:1;jenkins-hbase4:36945] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36945 2023-02-14 11:02:27,969 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:27,969 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36945,1676372542508 2023-02-14 11:02:27,969 ERROR [Listener at localhost/38713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31ba115a rejected from java.util.concurrent.ThreadPoolExecutor@358583b5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:27,970 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36945,1676372542508] 2023-02-14 11:02:27,970 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36945,1676372542508; numProcessing=2 2023-02-14 11:02:27,971 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36945,1676372542508 already deleted, retry=false 2023-02-14 11:02:27,972 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36945,1676372542508 expired; onlineServers=0 2023-02-14 11:02:27,972 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35119,1676372542423' ***** 2023-02-14 11:02:27,972 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-14 11:02:27,973 DEBUG [M:0;jenkins-hbase4:35119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f29cc7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:27,973 INFO [M:0;jenkins-hbase4:35119] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35119,1676372542423 2023-02-14 11:02:27,973 INFO [M:0;jenkins-hbase4:35119] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35119,1676372542423; all regions closed. 2023-02-14 11:02:27,973 DEBUG [M:0;jenkins-hbase4:35119] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:27,973 DEBUG [M:0;jenkins-hbase4:35119] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-14 11:02:27,973 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-14 11:02:27,973 DEBUG [M:0;jenkins-hbase4:35119] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-14 11:02:27,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372542697] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372542697,5,FailOnTimeoutGroup] 2023-02-14 11:02:27,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372542696] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372542696,5,FailOnTimeoutGroup] 2023-02-14 11:02:27,973 INFO [M:0;jenkins-hbase4:35119] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-14 11:02:27,974 INFO [M:0;jenkins-hbase4:35119] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-14 11:02:27,974 INFO [M:0;jenkins-hbase4:35119] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-14 11:02:27,974 DEBUG [M:0;jenkins-hbase4:35119] master.HMaster(1512): Stopping service threads 2023-02-14 11:02:27,974 INFO [M:0;jenkins-hbase4:35119] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-14 11:02:27,975 ERROR [M:0;jenkins-hbase4:35119] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-14 11:02:27,975 INFO [M:0;jenkins-hbase4:35119] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-14 11:02:27,975 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:27,975 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-14 11:02:27,975 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:27,975 DEBUG [M:0;jenkins-hbase4:35119] zookeeper.ZKUtil(398): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-14 11:02:27,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:27,975 WARN [M:0;jenkins-hbase4:35119] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-14 11:02:27,976 INFO [M:0;jenkins-hbase4:35119] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-14 11:02:27,976 INFO [M:0;jenkins-hbase4:35119] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-14 11:02:27,976 DEBUG [M:0;jenkins-hbase4:35119] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:27,976 INFO [M:0;jenkins-hbase4:35119] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:27,976 DEBUG [M:0;jenkins-hbase4:35119] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:27,976 DEBUG [M:0;jenkins-hbase4:35119] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:27,976 DEBUG [M:0;jenkins-hbase4:35119] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:27,977 INFO [M:0;jenkins-hbase4:35119] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.14 KB heapSize=200.04 KB 2023-02-14 11:02:27,985 INFO [M:0;jenkins-hbase4:35119] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.14 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6b8f7aad7ecc460c9d0fc98a68a32420 2023-02-14 11:02:27,989 DEBUG [M:0;jenkins-hbase4:35119] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6b8f7aad7ecc460c9d0fc98a68a32420 as hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6b8f7aad7ecc460c9d0fc98a68a32420 2023-02-14 11:02:27,992 INFO [M:0;jenkins-hbase4:35119] regionserver.HStore(1080): Added hdfs://localhost:39115/user/jenkins/test-data/0fb9fe9a-b612-4028-b1f8-ed19545ce11b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6b8f7aad7ecc460c9d0fc98a68a32420, entries=53, sequenceid=357, filesize=10.7 K 2023-02-14 11:02:27,993 INFO [M:0;jenkins-hbase4:35119] regionserver.HRegion(2947): Finished flush of dataSize ~167.14 KB/171150, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-14 11:02:27,993 INFO [M:0;jenkins-hbase4:35119] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:27,993 DEBUG [M:0;jenkins-hbase4:35119] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:27,996 INFO [M:0;jenkins-hbase4:35119] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-14 11:02:27,996 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:27,997 INFO [M:0;jenkins-hbase4:35119] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35119 2023-02-14 11:02:27,999 DEBUG [M:0;jenkins-hbase4:35119] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35119,1676372542423 already deleted, retry=false 2023-02-14 11:02:28,355 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:28,355 INFO [M:0;jenkins-hbase4:35119] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35119,1676372542423; zookeeper connection closed. 2023-02-14 11:02:28,355 ERROR [Listener at localhost/38713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34f59e01 rejected from java.util.concurrent.ThreadPoolExecutor@30ca0c47[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:28,356 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): master:35119-0x100527eed850000, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:28,356 ERROR [Listener at localhost/38713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c6a5e6b rejected from java.util.concurrent.ThreadPoolExecutor@30ca0c47[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:28,455 INFO [RS:1;jenkins-hbase4:36945] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36945,1676372542508; zookeeper connection closed. 2023-02-14 11:02:28,455 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:28,456 ERROR [Listener at localhost/38713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@206cfe74 rejected from java.util.concurrent.ThreadPoolExecutor@358583b5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:28,456 DEBUG [Listener at localhost/38713-EventThread] zookeeper.ZKWatcher(600): regionserver:36945-0x100527eed850002, quorum=127.0.0.1:60887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:28,456 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@30c839a6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@30c839a6 2023-02-14 11:02:28,456 ERROR [Listener at localhost/38713-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@583cb05b rejected from java.util.concurrent.ThreadPoolExecutor@358583b5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:28,456 INFO [Listener at localhost/38713] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-14 11:02:28,457 WARN [Listener at localhost/38713] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:28,460 INFO [Listener at localhost/38713] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:28,569 WARN [BP-1728439191-172.31.14.131-1676372541844 heartbeating to localhost/127.0.0.1:39115] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:28,569 WARN [BP-1728439191-172.31.14.131-1676372541844 heartbeating to localhost/127.0.0.1:39115] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1728439191-172.31.14.131-1676372541844 (Datanode Uuid 2f14324a-f27a-4bdd-9c9a-b17b3a62ea77) service to localhost/127.0.0.1:39115 2023-02-14 11:02:28,570 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/cluster_57d695fe-4bf7-42f8-8792-2ab6772df055/dfs/data/data3/current/BP-1728439191-172.31.14.131-1676372541844] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:28,570 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/cluster_57d695fe-4bf7-42f8-8792-2ab6772df055/dfs/data/data4/current/BP-1728439191-172.31.14.131-1676372541844] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:28,572 WARN [Listener at localhost/38713] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:28,574 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-14 11:02:28,588 INFO [Listener at localhost/38713] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:28,696 WARN [BP-1728439191-172.31.14.131-1676372541844 heartbeating to localhost/127.0.0.1:39115] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:28,696 WARN [BP-1728439191-172.31.14.131-1676372541844 heartbeating to localhost/127.0.0.1:39115] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1728439191-172.31.14.131-1676372541844 (Datanode Uuid fe75f8d3-ffb8-45f5-99a3-bcc5600df4e7) service to localhost/127.0.0.1:39115 2023-02-14 11:02:28,697 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/cluster_57d695fe-4bf7-42f8-8792-2ab6772df055/dfs/data/data1/current/BP-1728439191-172.31.14.131-1676372541844] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:28,697 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/cluster_57d695fe-4bf7-42f8-8792-2ab6772df055/dfs/data/data2/current/BP-1728439191-172.31.14.131-1676372541844] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:28,706 INFO [Listener at localhost/38713] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:28,825 INFO [Listener at localhost/38713] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-14 11:02:28,860 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-14 11:02:28,876 INFO [Listener at localhost/38713] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 179) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/38713 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:39115 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:39115 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:39115 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:39115 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:39115 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35119,1676372542423)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:39115 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39115 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38713.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=635 (was 574) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 282), ProcessCount=168 (was 168), AvailableMemoryMB=5628 (was 5694) 2023-02-14 11:02:28,886 INFO [Listener at localhost/38713] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=168, AvailableMemoryMB=5628 2023-02-14 11:02:28,897 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/hadoop.log.dir so I do NOT create it in target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9 2023-02-14 11:02:28,897 WARN [Listener at localhost/38713] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/hadoop.log.dir Erasing configuration value by system value. 2023-02-14 11:02:28,897 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/hadoop.tmp.dir so I do NOT create it in target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9 2023-02-14 11:02:28,897 WARN [Listener at localhost/38713] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/072e3147-82bc-2e30-aea0-2a8dcfad9b06/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-14 11:02:28,897 DEBUG [Listener at localhost/38713] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9 2023-02-14 11:02:28,897 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-14 11:02:28,897 INFO [Listener at localhost/38713] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/cluster_59175c2f-068c-c3d6-c489-d97e62c9344b, deleteOnExit=true 2023-02-14 11:02:28,897 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-14 11:02:28,897 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/test.cache.data in system properties and HBase conf 2023-02-14 11:02:28,897 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/hadoop.tmp.dir in system properties and HBase conf 2023-02-14 11:02:28,897 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/hadoop.log.dir in system properties and HBase conf 2023-02-14 11:02:28,897 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-14 11:02:28,898 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-14 11:02:28,898 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-14 11:02:28,898 DEBUG [Listener at localhost/38713] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-14 11:02:28,898 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:28,898 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:28,898 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-14 11:02:28,898 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:28,898 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-14 11:02:28,898 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-14 11:02:28,898 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:28,899 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:28,899 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-14 11:02:28,899 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/nfs.dump.dir in system properties and HBase conf 2023-02-14 11:02:28,899 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/java.io.tmpdir in system properties and HBase conf 2023-02-14 11:02:28,899 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:28,899 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-14 11:02:28,899 INFO [Listener at localhost/38713] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-14 11:02:28,903 WARN [Listener at localhost/38713] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:28,903 WARN [Listener at localhost/38713] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:28,942 WARN [Listener at localhost/38713] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:28,945 INFO [Listener at localhost/38713] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:28,951 INFO [Listener at localhost/38713] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/java.io.tmpdir/Jetty_localhost_34091_hdfs____.171vdb/webapp 2023-02-14 11:02:29,043 INFO [Listener at localhost/38713] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34091 2023-02-14 11:02:29,079 WARN [Listener at localhost/38713] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:29,079 WARN [Listener at localhost/38713] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:29,125 WARN [Listener at localhost/44743] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:29,139 WARN [Listener at localhost/44743] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:29,141 WARN [Listener at localhost/44743] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:29,142 INFO [Listener at localhost/44743] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:29,149 INFO [Listener at localhost/44743] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/java.io.tmpdir/Jetty_localhost_42385_datanode____.k3m413/webapp 2023-02-14 11:02:29,241 INFO [Listener at localhost/44743] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42385 2023-02-14 11:02:29,253 WARN [Listener at localhost/39793] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:29,275 WARN [Listener at localhost/39793] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:29,277 WARN [Listener at localhost/39793] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:29,278 INFO [Listener at localhost/39793] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:29,283 INFO [Listener at localhost/39793] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/java.io.tmpdir/Jetty_localhost_40097_datanode____.p1mdvr/webapp 2023-02-14 11:02:29,346 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x14ecd05842ddfd5f: Processing first storage report for DS-a0a36a1a-2def-4755-b20c-9b824750a7b1 from datanode a733bcda-45ca-4408-b332-35b134c5a68b 2023-02-14 11:02:29,346 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x14ecd05842ddfd5f: from storage DS-a0a36a1a-2def-4755-b20c-9b824750a7b1 node DatanodeRegistration(127.0.0.1:39405, datanodeUuid=a733bcda-45ca-4408-b332-35b134c5a68b, infoPort=44925, infoSecurePort=0, ipcPort=39793, storageInfo=lv=-57;cid=testClusterID;nsid=693620768;c=1676372548906), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:29,346 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x14ecd05842ddfd5f: Processing first storage report for DS-8d8f7fd4-0f8e-47e1-8c35-8104b55c1edd from datanode a733bcda-45ca-4408-b332-35b134c5a68b 2023-02-14 11:02:29,346 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x14ecd05842ddfd5f: from storage DS-8d8f7fd4-0f8e-47e1-8c35-8104b55c1edd node DatanodeRegistration(127.0.0.1:39405, datanodeUuid=a733bcda-45ca-4408-b332-35b134c5a68b, infoPort=44925, infoSecurePort=0, ipcPort=39793, storageInfo=lv=-57;cid=testClusterID;nsid=693620768;c=1676372548906), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:29,383 INFO [Listener at localhost/39793] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40097 2023-02-14 11:02:29,392 WARN [Listener at localhost/36455] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:29,486 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfaddc1490a1555b9: Processing first storage report for DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9 from datanode 65de1072-5e39-4416-bb37-7b26879ef18c 2023-02-14 11:02:29,486 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfaddc1490a1555b9: from storage DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9 node DatanodeRegistration(127.0.0.1:35221, datanodeUuid=65de1072-5e39-4416-bb37-7b26879ef18c, infoPort=35353, infoSecurePort=0, ipcPort=36455, storageInfo=lv=-57;cid=testClusterID;nsid=693620768;c=1676372548906), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:29,486 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfaddc1490a1555b9: Processing first storage report for DS-b6f32a89-7f6a-4a74-add1-b9389d08dae8 from datanode 65de1072-5e39-4416-bb37-7b26879ef18c 2023-02-14 11:02:29,486 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfaddc1490a1555b9: from storage DS-b6f32a89-7f6a-4a74-add1-b9389d08dae8 node DatanodeRegistration(127.0.0.1:35221, datanodeUuid=65de1072-5e39-4416-bb37-7b26879ef18c, infoPort=35353, infoSecurePort=0, ipcPort=36455, storageInfo=lv=-57;cid=testClusterID;nsid=693620768;c=1676372548906), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:29,498 DEBUG [Listener at localhost/36455] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9 2023-02-14 11:02:29,500 INFO [Listener at localhost/36455] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/cluster_59175c2f-068c-c3d6-c489-d97e62c9344b/zookeeper_0, clientPort=55750, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/cluster_59175c2f-068c-c3d6-c489-d97e62c9344b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/cluster_59175c2f-068c-c3d6-c489-d97e62c9344b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-14 11:02:29,501 INFO [Listener at localhost/36455] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55750 2023-02-14 11:02:29,501 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,502 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,516 INFO [Listener at localhost/36455] util.FSUtils(479): Created version file at hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8 with version=8 2023-02-14 11:02:29,516 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,517 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,519 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44743/user/jenkins/test-data/d58aec1c-44b7-2eca-1bd8-eaa653052d61/hbase-staging 2023-02-14 11:02:29,521 INFO [Listener at localhost/36455] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:29,521 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:29,521 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:29,521 INFO [Listener at localhost/36455] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:29,521 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:29,522 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:29,522 INFO [Listener at localhost/36455] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:29,522 INFO [Listener at localhost/36455] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37995 2023-02-14 11:02:29,523 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,524 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,525 INFO [Listener at localhost/36455] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37995 connecting to ZooKeeper ensemble=127.0.0.1:55750 2023-02-14 11:02:29,536 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:379950x0, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:29,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37995-0x100527f09400000 connected 2023-02-14 11:02:29,552 DEBUG [Listener at localhost/36455] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:29,552 DEBUG [Listener at localhost/36455] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:29,553 DEBUG [Listener at localhost/36455] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:29,553 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37995 2023-02-14 11:02:29,554 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37995 2023-02-14 11:02:29,554 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37995 2023-02-14 11:02:29,554 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37995 2023-02-14 11:02:29,554 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37995 2023-02-14 11:02:29,554 INFO [Listener at localhost/36455] master.HMaster(444): hbase.rootdir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8, hbase.cluster.distributed=false 2023-02-14 11:02:29,567 INFO [Listener at localhost/36455] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:29,567 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:29,567 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:29,567 INFO [Listener at localhost/36455] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:29,567 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:29,567 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:29,567 INFO [Listener at localhost/36455] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:29,568 INFO [Listener at localhost/36455] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33153 2023-02-14 11:02:29,568 INFO [Listener at localhost/36455] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:29,572 DEBUG [Listener at localhost/36455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:29,573 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,574 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,574 INFO [Listener at localhost/36455] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33153 connecting to ZooKeeper ensemble=127.0.0.1:55750 2023-02-14 11:02:29,579 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:331530x0, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:29,580 DEBUG [Listener at localhost/36455] zookeeper.ZKUtil(164): regionserver:331530x0, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:29,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33153-0x100527f09400001 connected 2023-02-14 11:02:29,581 DEBUG [Listener at localhost/36455] zookeeper.ZKUtil(164): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:29,581 DEBUG [Listener at localhost/36455] zookeeper.ZKUtil(164): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:29,588 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33153 2023-02-14 11:02:29,588 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33153 2023-02-14 11:02:29,588 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33153 2023-02-14 11:02:29,590 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33153 2023-02-14 11:02:29,592 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33153 2023-02-14 11:02:29,603 INFO [Listener at localhost/36455] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:29,603 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:29,603 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:29,603 INFO [Listener at localhost/36455] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:29,603 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:29,603 INFO [Listener at localhost/36455] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:29,603 INFO [Listener at localhost/36455] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:29,604 INFO [Listener at localhost/36455] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44655 2023-02-14 11:02:29,604 INFO [Listener at localhost/36455] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:29,605 DEBUG [Listener at localhost/36455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:29,606 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,606 INFO [Listener at localhost/36455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,607 INFO [Listener at localhost/36455] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44655 connecting to ZooKeeper ensemble=127.0.0.1:55750 2023-02-14 11:02:29,611 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:446550x0, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:29,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44655-0x100527f09400002 connected 2023-02-14 11:02:29,613 DEBUG [Listener at localhost/36455] zookeeper.ZKUtil(164): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:29,613 DEBUG [Listener at localhost/36455] zookeeper.ZKUtil(164): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:29,614 DEBUG [Listener at localhost/36455] zookeeper.ZKUtil(164): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:29,616 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44655 2023-02-14 11:02:29,619 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44655 2023-02-14 11:02:29,619 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44655 2023-02-14 11:02:29,619 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44655 2023-02-14 11:02:29,620 DEBUG [Listener at localhost/36455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44655 2023-02-14 11:02:29,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:29,622 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:29,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:29,625 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:29,625 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:29,625 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:29,625 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:29,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:29,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37995,1676372549520 from backup master directory 2023-02-14 11:02:29,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:29,629 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:29,629 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:29,629 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:29,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:29,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/hbase.id with ID: 864fe04d-25c8-4f5c-a8aa-b9961c7c84ed 2023-02-14 11:02:29,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:29,655 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:29,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x33bc51c2 to 127.0.0.1:55750 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:29,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17a81596, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:29,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:29,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-14 11:02:29,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:29,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/data/master/store-tmp 2023-02-14 11:02:29,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:29,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:29,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:29,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:29,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:29,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:29,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:29,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:29,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/WALs/jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:29,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37995%2C1676372549520, suffix=, logDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/WALs/jenkins-hbase4.apache.org,37995,1676372549520, archiveDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/oldWALs, maxLogs=10 2023-02-14 11:02:29,710 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35221,DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9,DISK] 2023-02-14 11:02:29,710 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39405,DS-a0a36a1a-2def-4755-b20c-9b824750a7b1,DISK] 2023-02-14 11:02:29,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/WALs/jenkins-hbase4.apache.org,37995,1676372549520/jenkins-hbase4.apache.org%2C37995%2C1676372549520.1676372549689 2023-02-14 11:02:29,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35221,DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9,DISK], DatanodeInfoWithStorage[127.0.0.1:39405,DS-a0a36a1a-2def-4755-b20c-9b824750a7b1,DISK]] 2023-02-14 11:02:29,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:29,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:29,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:29,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:29,716 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:29,717 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-14 11:02:29,717 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-14 11:02:29,718 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:29,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:29,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:29,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:29,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:29,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63008217, jitterRate=-0.06110440194606781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:29,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:29,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-14 11:02:29,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-14 11:02:29,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-14 11:02:29,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-14 11:02:29,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-14 11:02:29,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-14 11:02:29,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-14 11:02:29,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-14 11:02:29,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-14 11:02:29,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-14 11:02:29,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-14 11:02:29,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-14 11:02:29,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-14 11:02:29,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-14 11:02:29,743 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:29,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-14 11:02:29,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-14 11:02:29,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-14 11:02:29,745 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:29,745 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:29,745 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:29,745 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:29,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37995,1676372549520, sessionid=0x100527f09400000, setting cluster-up flag (Was=false) 2023-02-14 11:02:29,751 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:29,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-14 11:02:29,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:29,762 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:29,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-14 11:02:29,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:29,767 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.hbase-snapshot/.tmp 2023-02-14 11:02:29,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:29,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:29,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:29,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:29,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:29,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-14 11:02:29,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:29,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676372579773 2023-02-14 11:02:29,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-14 11:02:29,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-14 11:02:29,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-14 11:02:29,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-14 11:02:29,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-14 11:02:29,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-14 11:02:29,774 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:29,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,774 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-14 11:02:29,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-14 11:02:29,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-14 11:02:29,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-14 11:02:29,775 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:29,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-14 11:02:29,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-14 11:02:29,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372549780,5,FailOnTimeoutGroup] 2023-02-14 11:02:29,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372549781,5,FailOnTimeoutGroup] 2023-02-14 11:02:29,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-14 11:02:29,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,791 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:29,791 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:29,791 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8 2023-02-14 11:02:29,802 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:29,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:29,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/info 2023-02-14 11:02:29,805 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:29,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:29,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:29,806 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:29,806 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:29,807 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:29,807 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:29,808 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/table 2023-02-14 11:02:29,808 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:29,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:29,809 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740 2023-02-14 11:02:29,809 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740 2023-02-14 11:02:29,811 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:29,811 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:29,813 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:29,813 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62499067, jitterRate=-0.06869132816791534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:29,813 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:29,813 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:29,813 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:29,813 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:29,813 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:29,813 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:29,813 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:29,813 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:29,814 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:29,814 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-14 11:02:29,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-14 11:02:29,816 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-14 11:02:29,817 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-14 11:02:29,821 INFO [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(952): ClusterId : 864fe04d-25c8-4f5c-a8aa-b9961c7c84ed 2023-02-14 11:02:29,821 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(952): ClusterId : 864fe04d-25c8-4f5c-a8aa-b9961c7c84ed 2023-02-14 11:02:29,821 DEBUG [RS:0;jenkins-hbase4:33153] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:29,821 DEBUG [RS:1;jenkins-hbase4:44655] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:29,824 DEBUG [RS:0;jenkins-hbase4:33153] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:29,824 DEBUG [RS:0;jenkins-hbase4:33153] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:29,825 DEBUG [RS:1;jenkins-hbase4:44655] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:29,825 DEBUG [RS:1;jenkins-hbase4:44655] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:29,826 DEBUG [RS:0;jenkins-hbase4:33153] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:29,828 DEBUG [RS:1;jenkins-hbase4:44655] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:29,828 DEBUG [RS:0;jenkins-hbase4:33153] zookeeper.ReadOnlyZKClient(139): Connect 0x1ff6efc8 to 127.0.0.1:55750 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:29,829 DEBUG [RS:1;jenkins-hbase4:44655] zookeeper.ReadOnlyZKClient(139): Connect 0x2ad4f07e to 127.0.0.1:55750 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:29,837 DEBUG [RS:0;jenkins-hbase4:33153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11311246, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:29,837 DEBUG [RS:1;jenkins-hbase4:44655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24131b54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:29,837 DEBUG [RS:0;jenkins-hbase4:33153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@150e84b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:29,837 DEBUG [RS:1;jenkins-hbase4:44655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@202c9b0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:29,851 DEBUG [RS:0;jenkins-hbase4:33153] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33153 2023-02-14 11:02:29,851 DEBUG [RS:1;jenkins-hbase4:44655] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44655 2023-02-14 11:02:29,851 INFO [RS:0;jenkins-hbase4:33153] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:29,851 INFO [RS:0;jenkins-hbase4:33153] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:29,851 INFO [RS:1;jenkins-hbase4:44655] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:29,851 INFO [RS:1;jenkins-hbase4:44655] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:29,851 DEBUG [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:29,851 DEBUG [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:29,851 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37995,1676372549520 with isa=jenkins-hbase4.apache.org/172.31.14.131:44655, startcode=1676372549602 2023-02-14 11:02:29,851 INFO [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37995,1676372549520 with isa=jenkins-hbase4.apache.org/172.31.14.131:33153, startcode=1676372549566 2023-02-14 11:02:29,852 DEBUG [RS:0;jenkins-hbase4:33153] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:29,852 DEBUG [RS:1;jenkins-hbase4:44655] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:29,853 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56411, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:29,854 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37041, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:29,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37995] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:29,855 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:29,855 DEBUG [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8 2023-02-14 11:02:29,856 DEBUG [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44743 2023-02-14 11:02:29,856 DEBUG [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:29,856 DEBUG [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8 2023-02-14 11:02:29,856 DEBUG [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44743 2023-02-14 11:02:29,856 DEBUG [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:29,857 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:29,861 DEBUG [RS:0;jenkins-hbase4:33153] zookeeper.ZKUtil(162): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:29,861 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33153,1676372549566] 2023-02-14 11:02:29,861 WARN [RS:0;jenkins-hbase4:33153] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:29,861 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44655,1676372549602] 2023-02-14 11:02:29,861 INFO [RS:0;jenkins-hbase4:33153] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:29,861 DEBUG [RS:1;jenkins-hbase4:44655] zookeeper.ZKUtil(162): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:29,861 DEBUG [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/WALs/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:29,861 WARN [RS:1;jenkins-hbase4:44655] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:29,862 INFO [RS:1;jenkins-hbase4:44655] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:29,862 DEBUG [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/WALs/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:29,868 DEBUG [RS:0;jenkins-hbase4:33153] zookeeper.ZKUtil(162): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:29,869 DEBUG [RS:1;jenkins-hbase4:44655] zookeeper.ZKUtil(162): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:29,869 DEBUG [RS:0;jenkins-hbase4:33153] zookeeper.ZKUtil(162): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:29,869 DEBUG [RS:1;jenkins-hbase4:44655] zookeeper.ZKUtil(162): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:29,869 DEBUG [RS:0;jenkins-hbase4:33153] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:29,869 DEBUG [RS:1;jenkins-hbase4:44655] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:29,870 INFO [RS:0;jenkins-hbase4:33153] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:29,870 INFO [RS:1;jenkins-hbase4:44655] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:29,871 INFO [RS:0;jenkins-hbase4:33153] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:29,871 INFO [RS:0;jenkins-hbase4:33153] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:29,871 INFO [RS:0;jenkins-hbase4:33153] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,871 INFO [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:29,876 INFO [RS:1;jenkins-hbase4:44655] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:29,876 INFO [RS:0;jenkins-hbase4:33153] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,877 INFO [RS:1;jenkins-hbase4:44655] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:29,877 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,877 INFO [RS:1;jenkins-hbase4:44655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,877 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,877 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,877 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,877 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:29,877 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,877 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:29,877 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,878 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,878 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,878 DEBUG [RS:0;jenkins-hbase4:33153] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,878 INFO [RS:1;jenkins-hbase4:44655] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,879 INFO [RS:0;jenkins-hbase4:33153] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,879 INFO [RS:0;jenkins-hbase4:33153] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,879 INFO [RS:0;jenkins-hbase4:33153] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,879 DEBUG [RS:1;jenkins-hbase4:44655] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:29,884 INFO [RS:1;jenkins-hbase4:44655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,884 INFO [RS:1;jenkins-hbase4:44655] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,884 INFO [RS:1;jenkins-hbase4:44655] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,894 INFO [RS:0;jenkins-hbase4:33153] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:29,894 INFO [RS:0;jenkins-hbase4:33153] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33153,1676372549566-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,894 INFO [RS:1;jenkins-hbase4:44655] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:29,894 INFO [RS:1;jenkins-hbase4:44655] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44655,1676372549602-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:29,904 INFO [RS:0;jenkins-hbase4:33153] regionserver.Replication(203): jenkins-hbase4.apache.org,33153,1676372549566 started 2023-02-14 11:02:29,904 INFO [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33153,1676372549566, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33153, sessionid=0x100527f09400001 2023-02-14 11:02:29,904 INFO [RS:1;jenkins-hbase4:44655] regionserver.Replication(203): jenkins-hbase4.apache.org,44655,1676372549602 started 2023-02-14 11:02:29,904 DEBUG [RS:0;jenkins-hbase4:33153] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:29,904 DEBUG [RS:0;jenkins-hbase4:33153] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:29,904 DEBUG [RS:0;jenkins-hbase4:33153] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33153,1676372549566' 2023-02-14 11:02:29,904 DEBUG [RS:0;jenkins-hbase4:33153] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:29,904 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44655,1676372549602, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44655, sessionid=0x100527f09400002 2023-02-14 11:02:29,904 DEBUG [RS:1;jenkins-hbase4:44655] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:29,904 DEBUG [RS:1;jenkins-hbase4:44655] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:29,904 DEBUG [RS:1;jenkins-hbase4:44655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44655,1676372549602' 2023-02-14 11:02:29,904 DEBUG [RS:1;jenkins-hbase4:44655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:29,905 DEBUG [RS:0;jenkins-hbase4:33153] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:29,905 DEBUG [RS:1;jenkins-hbase4:44655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:29,905 DEBUG [RS:0;jenkins-hbase4:33153] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:29,905 DEBUG [RS:0;jenkins-hbase4:33153] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:29,905 DEBUG [RS:0;jenkins-hbase4:33153] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:29,905 DEBUG [RS:0;jenkins-hbase4:33153] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33153,1676372549566' 2023-02-14 11:02:29,905 DEBUG [RS:0;jenkins-hbase4:33153] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:29,905 DEBUG [RS:1;jenkins-hbase4:44655] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:29,905 DEBUG [RS:1;jenkins-hbase4:44655] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:29,905 DEBUG [RS:1;jenkins-hbase4:44655] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:29,905 DEBUG [RS:1;jenkins-hbase4:44655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44655,1676372549602' 2023-02-14 11:02:29,905 DEBUG [RS:1;jenkins-hbase4:44655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:29,905 DEBUG [RS:0;jenkins-hbase4:33153] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:29,906 DEBUG [RS:1;jenkins-hbase4:44655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:29,906 DEBUG [RS:0;jenkins-hbase4:33153] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:29,906 INFO [RS:0;jenkins-hbase4:33153] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:29,906 INFO [RS:0;jenkins-hbase4:33153] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:29,906 DEBUG [RS:1;jenkins-hbase4:44655] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:29,906 INFO [RS:1;jenkins-hbase4:44655] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:29,906 INFO [RS:1;jenkins-hbase4:44655] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:29,967 DEBUG [jenkins-hbase4:37995] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-14 11:02:29,967 DEBUG [jenkins-hbase4:37995] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:29,969 DEBUG [jenkins-hbase4:37995] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:29,969 DEBUG [jenkins-hbase4:37995] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:29,969 DEBUG [jenkins-hbase4:37995] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:29,969 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44655,1676372549602, state=OPENING 2023-02-14 11:02:29,970 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-14 11:02:29,972 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:29,972 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:29,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44655,1676372549602}] 2023-02-14 11:02:30,129 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:30,129 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:30,130 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:30,135 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-14 11:02:30,135 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:30,136 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44655%2C1676372549602.meta, suffix=.meta, logDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/WALs/jenkins-hbase4.apache.org,44655,1676372549602, archiveDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/oldWALs, maxLogs=32 2023-02-14 11:02:30,149 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35221,DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9,DISK] 2023-02-14 11:02:30,149 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39405,DS-a0a36a1a-2def-4755-b20c-9b824750a7b1,DISK] 2023-02-14 11:02:30,151 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/WALs/jenkins-hbase4.apache.org,44655,1676372549602/jenkins-hbase4.apache.org%2C44655%2C1676372549602.meta.1676372550137.meta 2023-02-14 11:02:30,151 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35221,DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9,DISK], DatanodeInfoWithStorage[127.0.0.1:39405,DS-a0a36a1a-2def-4755-b20c-9b824750a7b1,DISK]] 2023-02-14 11:02:30,151 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:30,151 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-14 11:02:30,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-14 11:02:30,152 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-14 11:02:30,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-14 11:02:30,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:30,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-14 11:02:30,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-14 11:02:30,154 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:30,155 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/info 2023-02-14 11:02:30,155 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/info 2023-02-14 11:02:30,155 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:30,156 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:30,156 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:30,157 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:30,157 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:30,157 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:30,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:30,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:30,158 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/table 2023-02-14 11:02:30,158 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/table 2023-02-14 11:02:30,158 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:30,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:30,159 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740 2023-02-14 11:02:30,160 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740 2023-02-14 11:02:30,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:30,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:30,163 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60990848, jitterRate=-0.09116554260253906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:30,163 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:30,164 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676372550128 2023-02-14 11:02:30,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-14 11:02:30,168 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-14 11:02:30,168 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44655,1676372549602, state=OPEN 2023-02-14 11:02:30,175 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-14 11:02:30,175 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:30,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-14 11:02:30,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44655,1676372549602 in 203 msec 2023-02-14 11:02:30,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-14 11:02:30,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 363 msec 2023-02-14 11:02:30,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 411 msec 2023-02-14 11:02:30,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676372550179, completionTime=-1 2023-02-14 11:02:30,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-14 11:02:30,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-14 11:02:30,181 DEBUG [hconnection-0x2cc4620b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:30,182 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55116, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:30,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-14 11:02:30,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676372610183 2023-02-14 11:02:30,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676372670183 2023-02-14 11:02:30,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-14 11:02:30,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37995,1676372549520-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:30,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37995,1676372549520-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:30,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37995,1676372549520-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:30,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37995, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:30,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:30,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-14 11:02:30,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:30,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-14 11:02:30,191 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-14 11:02:30,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:30,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:30,194 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:30,194 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87 empty. 2023-02-14 11:02:30,194 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:30,194 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-14 11:02:30,202 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:30,203 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => cd41501335d23a88c39b8fc8f496ee87, NAME => 'hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp 2023-02-14 11:02:30,209 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:30,209 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing cd41501335d23a88c39b8fc8f496ee87, disabling compactions & flushes 2023-02-14 11:02:30,209 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:30,209 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:30,209 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. after waiting 0 ms 2023-02-14 11:02:30,209 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:30,209 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:30,209 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for cd41501335d23a88c39b8fc8f496ee87: 2023-02-14 11:02:30,211 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:30,211 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372550211"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372550211"}]},"ts":"1676372550211"} 2023-02-14 11:02:30,214 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:30,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:30,214 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372550214"}]},"ts":"1676372550214"} 2023-02-14 11:02:30,215 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-14 11:02:30,219 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:30,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:30,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:30,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:30,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cd41501335d23a88c39b8fc8f496ee87, ASSIGN}] 2023-02-14 11:02:30,222 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cd41501335d23a88c39b8fc8f496ee87, ASSIGN 2023-02-14 11:02:30,223 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cd41501335d23a88c39b8fc8f496ee87, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44655,1676372549602; forceNewPlan=false, retain=false 2023-02-14 11:02:30,373 INFO [jenkins-hbase4:37995] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:30,373 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cd41501335d23a88c39b8fc8f496ee87, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:30,373 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372550373"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372550373"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372550373"}]},"ts":"1676372550373"} 2023-02-14 11:02:30,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cd41501335d23a88c39b8fc8f496ee87, server=jenkins-hbase4.apache.org,44655,1676372549602}] 2023-02-14 11:02:30,530 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:30,531 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44655%2C1676372549602, suffix=, logDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/WALs/jenkins-hbase4.apache.org,44655,1676372549602, archiveDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/oldWALs, maxLogs=32 2023-02-14 11:02:30,548 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35221,DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9,DISK] 2023-02-14 11:02:30,549 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39405,DS-a0a36a1a-2def-4755-b20c-9b824750a7b1,DISK] 2023-02-14 11:02:30,550 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/WALs/jenkins-hbase4.apache.org,44655,1676372549602/jenkins-hbase4.apache.org%2C44655%2C1676372549602.1676372550531 2023-02-14 11:02:30,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35221,DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9,DISK], DatanodeInfoWithStorage[127.0.0.1:39405,DS-a0a36a1a-2def-4755-b20c-9b824750a7b1,DISK]] 2023-02-14 11:02:30,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cd41501335d23a88c39b8fc8f496ee87, NAME => 'hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:30,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:30,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:30,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:30,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:30,552 INFO [StoreOpener-cd41501335d23a88c39b8fc8f496ee87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:30,553 DEBUG [StoreOpener-cd41501335d23a88c39b8fc8f496ee87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87/info 2023-02-14 11:02:30,553 DEBUG [StoreOpener-cd41501335d23a88c39b8fc8f496ee87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87/info 2023-02-14 11:02:30,554 INFO [StoreOpener-cd41501335d23a88c39b8fc8f496ee87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd41501335d23a88c39b8fc8f496ee87 columnFamilyName info 2023-02-14 11:02:30,554 INFO [StoreOpener-cd41501335d23a88c39b8fc8f496ee87-1] regionserver.HStore(310): Store=cd41501335d23a88c39b8fc8f496ee87/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:30,555 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:30,555 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:30,557 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:30,559 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:30,559 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cd41501335d23a88c39b8fc8f496ee87; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68617153, jitterRate=0.022475257515907288}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:30,559 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cd41501335d23a88c39b8fc8f496ee87: 2023-02-14 11:02:30,560 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87., pid=6, masterSystemTime=1676372550527 2023-02-14 11:02:30,562 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:30,562 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:30,562 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cd41501335d23a88c39b8fc8f496ee87, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:30,562 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372550562"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372550562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372550562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372550562"}]},"ts":"1676372550562"} 2023-02-14 11:02:30,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-14 11:02:30,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cd41501335d23a88c39b8fc8f496ee87, server=jenkins-hbase4.apache.org,44655,1676372549602 in 189 msec 2023-02-14 11:02:30,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-14 11:02:30,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cd41501335d23a88c39b8fc8f496ee87, ASSIGN in 345 msec 2023-02-14 11:02:30,566 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:30,567 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372550566"}]},"ts":"1676372550566"} 2023-02-14 11:02:30,567 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-14 11:02:30,570 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:30,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 380 msec 2023-02-14 11:02:30,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-14 11:02:30,593 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:30,593 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:30,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-14 11:02:30,602 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:30,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-14 11:02:30,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-14 11:02:30,612 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:30,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 6 msec 2023-02-14 11:02:30,622 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-14 11:02:30,624 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-14 11:02:30,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.995sec 2023-02-14 11:02:30,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-14 11:02:30,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-14 11:02:30,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-14 11:02:30,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37995,1676372549520-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-14 11:02:30,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37995,1676372549520-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-14 11:02:30,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-14 11:02:30,722 DEBUG [Listener at localhost/36455] zookeeper.ReadOnlyZKClient(139): Connect 0x433639b8 to 127.0.0.1:55750 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:30,730 DEBUG [Listener at localhost/36455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e72a1ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:30,731 DEBUG [hconnection-0x450e430b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:30,734 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55132, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:30,735 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:30,735 DEBUG [Listener at localhost/36455] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-14 11:02:30,737 DEBUG [Listener at localhost/36455] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-14 11:02:30,740 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45874, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-14 11:02:30,741 INFO [Listener at localhost/36455] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-14 11:02:30,741 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-14 11:02:30,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-14 11:02:30,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:45874 deadline: 1676372610741, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-14 11:02:30,742 INFO [Listener at localhost/36455] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-14 11:02:30,744 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:30,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:30,746 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:30,746 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-14 11:02:30,746 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:30,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:30,748 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309 2023-02-14 11:02:30,748 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309 empty. 2023-02-14 11:02:30,748 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309 2023-02-14 11:02:30,749 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-14 11:02:30,756 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:30,757 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 676934fe65998279aea195a434a5f309, NAME => 'testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp 2023-02-14 11:02:30,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:30,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 676934fe65998279aea195a434a5f309, disabling compactions & flushes 2023-02-14 11:02:30,763 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:30,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:30,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. after waiting 0 ms 2023-02-14 11:02:30,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:30,763 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:30,764 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 676934fe65998279aea195a434a5f309: 2023-02-14 11:02:30,765 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:30,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676372550766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372550766"}]},"ts":"1676372550766"} 2023-02-14 11:02:30,767 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:30,768 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:30,768 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372550768"}]},"ts":"1676372550768"} 2023-02-14 11:02:30,769 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-14 11:02:30,772 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:30,773 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:30,773 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:30,773 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:30,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=676934fe65998279aea195a434a5f309, ASSIGN}] 2023-02-14 11:02:30,775 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=676934fe65998279aea195a434a5f309, ASSIGN 2023-02-14 11:02:30,775 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=676934fe65998279aea195a434a5f309, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33153,1676372549566; forceNewPlan=false, retain=false 2023-02-14 11:02:30,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:30,907 INFO [RS:0;jenkins-hbase4:33153] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33153%2C1676372549566, suffix=, logDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/WALs/jenkins-hbase4.apache.org,33153,1676372549566, archiveDir=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/oldWALs, maxLogs=32 2023-02-14 11:02:30,922 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39405,DS-a0a36a1a-2def-4755-b20c-9b824750a7b1,DISK] 2023-02-14 11:02:30,922 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35221,DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9,DISK] 2023-02-14 11:02:30,924 INFO [RS:0;jenkins-hbase4:33153] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/WALs/jenkins-hbase4.apache.org,33153,1676372549566/jenkins-hbase4.apache.org%2C33153%2C1676372549566.1676372550908 2023-02-14 11:02:30,924 DEBUG [RS:0;jenkins-hbase4:33153] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39405,DS-a0a36a1a-2def-4755-b20c-9b824750a7b1,DISK], DatanodeInfoWithStorage[127.0.0.1:35221,DS-96fcd8f4-907e-4f79-86dd-baa4d8f11ea9,DISK]] 2023-02-14 11:02:30,926 INFO [jenkins-hbase4:37995] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:30,926 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=676934fe65998279aea195a434a5f309, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:30,926 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676372550926"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372550926"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372550926"}]},"ts":"1676372550926"} 2023-02-14 11:02:30,927 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 676934fe65998279aea195a434a5f309, server=jenkins-hbase4.apache.org,33153,1676372549566}] 2023-02-14 11:02:31,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:31,080 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,080 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:31,082 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55914, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:31,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:31,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 676934fe65998279aea195a434a5f309, NAME => 'testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:31,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 676934fe65998279aea195a434a5f309 2023-02-14 11:02:31,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:31,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 676934fe65998279aea195a434a5f309 2023-02-14 11:02:31,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 676934fe65998279aea195a434a5f309 2023-02-14 11:02:31,086 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 676934fe65998279aea195a434a5f309 2023-02-14 11:02:31,087 DEBUG [StoreOpener-676934fe65998279aea195a434a5f309-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1 2023-02-14 11:02:31,087 DEBUG [StoreOpener-676934fe65998279aea195a434a5f309-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1 2023-02-14 11:02:31,087 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 676934fe65998279aea195a434a5f309 columnFamilyName f1 2023-02-14 11:02:31,088 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(310): Store=676934fe65998279aea195a434a5f309/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:31,088 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 676934fe65998279aea195a434a5f309 2023-02-14 11:02:31,089 DEBUG [StoreOpener-676934fe65998279aea195a434a5f309-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2 2023-02-14 11:02:31,089 DEBUG [StoreOpener-676934fe65998279aea195a434a5f309-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2 2023-02-14 11:02:31,089 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 676934fe65998279aea195a434a5f309 columnFamilyName f2 2023-02-14 11:02:31,089 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(310): Store=676934fe65998279aea195a434a5f309/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:31,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309 2023-02-14 11:02:31,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309 2023-02-14 11:02:31,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:31,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 676934fe65998279aea195a434a5f309 2023-02-14 11:02:31,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:31,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 676934fe65998279aea195a434a5f309; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71406849, jitterRate=0.06404496729373932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:31,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 676934fe65998279aea195a434a5f309: 2023-02-14 11:02:31,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309., pid=12, masterSystemTime=1676372551080 2023-02-14 11:02:31,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:31,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:31,101 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=676934fe65998279aea195a434a5f309, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,101 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676372551101"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372551101"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372551101"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372551101"}]},"ts":"1676372551101"} 2023-02-14 11:02:31,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-14 11:02:31,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 676934fe65998279aea195a434a5f309, server=jenkins-hbase4.apache.org,33153,1676372549566 in 176 msec 2023-02-14 11:02:31,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-14 11:02:31,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=676934fe65998279aea195a434a5f309, ASSIGN in 331 msec 2023-02-14 11:02:31,105 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:31,106 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372551106"}]},"ts":"1676372551106"} 2023-02-14 11:02:31,107 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-14 11:02:31,109 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:31,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 365 msec 2023-02-14 11:02:31,177 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:31,177 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-14 11:02:31,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:31,352 INFO [Listener at localhost/36455] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-14 11:02:31,352 DEBUG [Listener at localhost/36455] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-14 11:02:31,352 INFO [Listener at localhost/36455] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:31,354 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-14 11:02:31,354 INFO [Listener at localhost/36455] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:31,354 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-14 11:02:31,354 INFO [Listener at localhost/36455] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-14 11:02:31,374 DEBUG [hconnection-0x450e430b-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:31,387 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55920, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:31,394 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33153] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:31,484 INFO [Listener at localhost/36455] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-14 11:02:31,485 INFO [Listener at localhost/36455] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-14 11:02:31,486 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-14 11:02:31,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676372551486 (current time:1676372551486). 2023-02-14 11:02:31,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-14 11:02:31,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] zookeeper.ReadOnlyZKClient(139): Connect 0x492f663c to 127.0.0.1:55750 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:31,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b5e5900, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:31,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:31,491 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55140, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:31,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x492f663c to 127.0.0.1:55750 2023-02-14 11:02:31,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:31,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-14 11:02:31,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-14 11:02:31,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-14 11:02:31,495 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-14 11:02:31,496 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676373151496 2023-02-14 11:02:31,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-14 11:02:31,496 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,497 DEBUG [Listener at localhost/36455] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:31,498 DEBUG [Listener at localhost/36455] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-14 11:02:31,498 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-14 11:02:31,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-14 11:02:31,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-14 11:02:31,500 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-14 11:02:31,500 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676373151500 2023-02-14 11:02:31,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,513 INFO [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-14 11:02:31,513 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:31,514 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-14 11:02:31,514 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-14 11:02:31,514 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,514 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,515 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:31,515 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,515 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:31,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:31,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:31,515 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,516 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:31,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-14 11:02:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-14 11:02:31,517 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-14 11:02:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,517 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-14 11:02:31,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,520 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-14 11:02:31,520 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-14 11:02:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-14 11:02:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-14 11:02:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33153,1676372549566' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-14 11:02:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-14 11:02:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-14 11:02:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44655,1676372549602' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-14 11:02:31,523 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,523 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:31,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:31,524 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,524 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,524 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:31,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:31,524 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,524 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:31,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:31,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:31,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33153,1676372549566' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-14 11:02:31,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@288245a2[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:31,526 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-14 11:02:31,526 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,533 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,533 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,533 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,533 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,533 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-14 11:02:31,533 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-14 11:02:31,533 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-14 11:02:31,533 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44655,1676372549602' in zk 2023-02-14 11:02:31,533 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-14 11:02:31,533 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:02:31,533 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:31,533 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. started... 2023-02-14 11:02:31,534 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 676934fe65998279aea195a434a5f309 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-14 11:02:31,534 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-14 11:02:31,535 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:31,535 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-14 11:02:31,554 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/.tmp/f1/d683eed8e0fe4dc68c6330893a9008c3 2023-02-14 11:02:31,571 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/.tmp/f2/9600b45ae9f24dbc94fb72452000bce2 2023-02-14 11:02:31,575 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/.tmp/f1/d683eed8e0fe4dc68c6330893a9008c3 as hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/d683eed8e0fe4dc68c6330893a9008c3 2023-02-14 11:02:31,578 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/d683eed8e0fe4dc68c6330893a9008c3, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-14 11:02:31,579 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/.tmp/f2/9600b45ae9f24dbc94fb72452000bce2 as hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/9600b45ae9f24dbc94fb72452000bce2 2023-02-14 11:02:31,583 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/9600b45ae9f24dbc94fb72452000bce2, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-14 11:02:31,584 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 676934fe65998279aea195a434a5f309 in 50ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:31,584 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-14 11:02:31,584 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 676934fe65998279aea195a434a5f309: 2023-02-14 11:02:31,584 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,584 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:31,584 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/d683eed8e0fe4dc68c6330893a9008c3] hfiles 2023-02-14 11:02:31,584 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/d683eed8e0fe4dc68c6330893a9008c3 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,584 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/9600b45ae9f24dbc94fb72452000bce2] hfiles 2023-02-14 11:02:31,584 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/9600b45ae9f24dbc94fb72452000bce2 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,590 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. completed. 2023-02-14 11:02:31,590 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:31,590 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-14 11:02:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-14 11:02:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-14 11:02:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33153,1676372549566' in zk 2023-02-14 11:02:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-14 11:02:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:31,592 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-14 11:02:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:31,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:31,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:31,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33153,1676372549566': 2023-02-14 11:02:31,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33153,1676372549566' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-14 11:02:31,596 INFO [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-14 11:02:31,596 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:31,596 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:31,596 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,596 INFO [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-14 11:02:31,597 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,597 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:31,597 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:31,597 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,598 DEBUG [Listener at localhost/36455] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:31,598 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:31,598 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:31,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:31,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:31,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,600 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-14 11:02:31,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:31,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:31,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,600 DEBUG [Listener at localhost/36455] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-14 11:02:31,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:31,601 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,602 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,608 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:31,608 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:31,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:31,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:31,608 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,609 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:31,609 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:31,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:31,608 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:31,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:31,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:31,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:31,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,609 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,609 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,609 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,609 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,609 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,609 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,609 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,609 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:31,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:31,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-14 11:02:31,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,638 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676372551496Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676372551609 (+113 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676372551609Writing data manifest for testWithMockedMapReduceSingleRegion at 1676372551612 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676372551619 (+7 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676372551637 (+18 ms) 2023-02-14 11:02:31,640 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-14 11:02:31,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 143 msec 2023-02-14 11:02:31,801 DEBUG [Listener at localhost/36455] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:31,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-14 11:02:31,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-14 11:02:31,802 INFO [Listener at localhost/36455] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-14 11:02:31,806 INFO [Listener at localhost/36455] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-14 11:02:31,810 INFO [Listener at localhost/36455] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-14 11:02:31,837 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33153] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:31,935 INFO [Listener at localhost/36455] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-14 11:02:31,940 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-14 11:02:31,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,942 INFO [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-14 11:02:31,942 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:31,942 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-14 11:02:31,942 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-14 11:02:31,943 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,943 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,944 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:31,944 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:31,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:31,944 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:31,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:31,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:31,944 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,944 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,946 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-14 11:02:31,946 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-14 11:02:31,946 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:31,946 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-14 11:02:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-14 11:02:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-14 11:02:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44655,1676372549602' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-14 11:02:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-14 11:02:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:31,948 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:31,948 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. started... 2023-02-14 11:02:31,948 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 676934fe65998279aea195a434a5f309 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-14 11:02:31,949 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:31,961 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/.tmp/f1/610493a0f39a4b2eadc4d90e5a90cc77 2023-02-14 11:02:31,978 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/.tmp/f2/57a810fa34284c1a86c47fcd7f03748f 2023-02-14 11:02:31,982 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/.tmp/f1/610493a0f39a4b2eadc4d90e5a90cc77 as hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/610493a0f39a4b2eadc4d90e5a90cc77 2023-02-14 11:02:31,986 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/610493a0f39a4b2eadc4d90e5a90cc77, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-14 11:02:31,987 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/.tmp/f2/57a810fa34284c1a86c47fcd7f03748f as hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/57a810fa34284c1a86c47fcd7f03748f 2023-02-14 11:02:31,991 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/57a810fa34284c1a86c47fcd7f03748f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-14 11:02:31,991 INFO [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 676934fe65998279aea195a434a5f309 in 43ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:31,993 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 676934fe65998279aea195a434a5f309: 2023-02-14 11:02:31,993 DEBUG [rs(jenkins-hbase4.apache.org,33153,1676372549566)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:31,993 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-14 11:02:31,993 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-14 11:02:31,993 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,993 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-14 11:02:31,993 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33153,1676372549566' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-14 11:02:31,994 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,994 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:31,995 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,995 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:31,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:31,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33153,1676372549566' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-14 11:02:31,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cbdc46a[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:31,996 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-14 11:02:31,996 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,998 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,998 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:31,998 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-14 11:02:31,998 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-14 11:02:31,998 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-14 11:02:31,998 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-14 11:02:31,999 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33153,1676372549566' in zk 2023-02-14 11:02:31,998 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:31,999 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:31,998 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44655,1676372549602' in zk 2023-02-14 11:02:32,000 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:32,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:32,000 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-14 11:02:32,000 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:32,000 DEBUG [member: 'jenkins-hbase4.apache.org,33153,1676372549566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-14 11:02:32,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:32,001 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-14 11:02:32,001 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:32,001 DEBUG [member: 'jenkins-hbase4.apache.org,44655,1676372549602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-14 11:02:32,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:32,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:32,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33153,1676372549566': 2023-02-14 11:02:32,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33153,1676372549566' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-14 11:02:32,003 INFO [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-14 11:02:32,003 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:32,003 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:32,003 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,003 INFO [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-14 11:02:32,004 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,004 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,004 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:32,004 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:32,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,005 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:32,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,005 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:32,005 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,007 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:32,007 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,010 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:32,010 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,010 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:32,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:32,010 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:32,010 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-14 11:02:32,010 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-14 11:02:32,010 DEBUG [(jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:32,010 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,010 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:32,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:32,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:32,011 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,011 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,011 DEBUG [Listener at localhost/36455] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:32,011 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,011 DEBUG [Listener at localhost/36455] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-14 11:02:32,011 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:32,011 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:32,011 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,011 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,111 DEBUG [Listener at localhost/36455] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-14 11:02:32,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-14 11:02:32,116 INFO [Listener at localhost/36455] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676372551486 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:32,117 DEBUG [Listener at localhost/36455] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44743/user/jenkins/test-data/d58aec1c-44b7-2eca-1bd8-eaa653052d61/testWithMockedMapReduceSingleRegion/fc9675e8-8db7-4eb9-a70a-d470b3cdb113/data/default/testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,117 INFO [Listener at localhost/36455] snapshot.RestoreSnapshotHelper(239): region to add: 676934fe65998279aea195a434a5f309 2023-02-14 11:02:32,117 INFO [Listener at localhost/36455] snapshot.RestoreSnapshotHelper(585): clone region=676934fe65998279aea195a434a5f309 as 676934fe65998279aea195a434a5f309 in snapshot testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,118 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 676934fe65998279aea195a434a5f309, NAME => 'testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44743/user/jenkins/test-data/d58aec1c-44b7-2eca-1bd8-eaa653052d61/testWithMockedMapReduceSingleRegion/fc9675e8-8db7-4eb9-a70a-d470b3cdb113 2023-02-14 11:02:32,126 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:32,126 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d683eed8e0fe4dc68c6330893a9008c3 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,128 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9600b45ae9f24dbc94fb72452000bce2 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,129 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 676934fe65998279aea195a434a5f309, disabling compactions & flushes 2023-02-14 11:02:32,129 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,129 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,129 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. after waiting 0 ms 2023-02-14 11:02:32,130 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,130 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,130 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 676934fe65998279aea195a434a5f309: 2023-02-14 11:02:32,130 INFO [Listener at localhost/36455] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676372551486 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:32,130 DEBUG [Listener at localhost/36455] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44743/user/jenkins/test-data/d58aec1c-44b7-2eca-1bd8-eaa653052d61/testWithMockedMapReduceSingleRegion/fc9675e8-8db7-4eb9-a70a-d470b3cdb113 2023-02-14 11:02:32,130 DEBUG [Listener at localhost/36455] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44743/user/jenkins/test-data/d58aec1c-44b7-2eca-1bd8-eaa653052d61/testWithMockedMapReduceSingleRegion/fc9675e8-8db7-4eb9-a70a-d470b3cdb113 2023-02-14 11:02:32,130 DEBUG [Listener at localhost/36455] util.CommonFSUtils(699): |-data/ 2023-02-14 11:02:32,131 DEBUG [Listener at localhost/36455] util.CommonFSUtils(699): |----default/ 2023-02-14 11:02:32,131 DEBUG [Listener at localhost/36455] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-14 11:02:32,131 DEBUG [Listener at localhost/36455] util.CommonFSUtils(699): |----------676934fe65998279aea195a434a5f309/ 2023-02-14 11:02:32,131 DEBUG [Listener at localhost/36455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:32,132 DEBUG [Listener at localhost/36455] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:32,132 DEBUG [Listener at localhost/36455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=676934fe65998279aea195a434a5f309-d683eed8e0fe4dc68c6330893a9008c3 2023-02-14 11:02:32,132 DEBUG [Listener at localhost/36455] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:32,132 DEBUG [Listener at localhost/36455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=676934fe65998279aea195a434a5f309-9600b45ae9f24dbc94fb72452000bce2 2023-02-14 11:02:32,135 INFO [Listener at localhost/36455] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-14 11:02:32,138 DEBUG [Listener at localhost/36455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:32,138 INFO [Listener at localhost/36455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:32,138 DEBUG [Listener at localhost/36455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:32,140 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 676934fe65998279aea195a434a5f309 2023-02-14 11:02:32,141 DEBUG [StoreOpener-676934fe65998279aea195a434a5f309-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/d58aec1c-44b7-2eca-1bd8-eaa653052d61/testWithMockedMapReduceSingleRegion/fc9675e8-8db7-4eb9-a70a-d470b3cdb113/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1 2023-02-14 11:02:32,141 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 676934fe65998279aea195a434a5f309 columnFamilyName f1 2023-02-14 11:02:32,144 DEBUG [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(539): loaded hdfs://localhost:44743/user/jenkins/test-data/d58aec1c-44b7-2eca-1bd8-eaa653052d61/testWithMockedMapReduceSingleRegion/fc9675e8-8db7-4eb9-a70a-d470b3cdb113/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/testWithMockedMapReduceSingleRegion=676934fe65998279aea195a434a5f309-d683eed8e0fe4dc68c6330893a9008c3 2023-02-14 11:02:32,144 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(310): Store=676934fe65998279aea195a434a5f309/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:32,144 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 676934fe65998279aea195a434a5f309 2023-02-14 11:02:32,145 DEBUG [StoreOpener-676934fe65998279aea195a434a5f309-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44743/user/jenkins/test-data/d58aec1c-44b7-2eca-1bd8-eaa653052d61/testWithMockedMapReduceSingleRegion/fc9675e8-8db7-4eb9-a70a-d470b3cdb113/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2 2023-02-14 11:02:32,145 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 676934fe65998279aea195a434a5f309 columnFamilyName f2 2023-02-14 11:02:32,148 DEBUG [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(539): loaded hdfs://localhost:44743/user/jenkins/test-data/d58aec1c-44b7-2eca-1bd8-eaa653052d61/testWithMockedMapReduceSingleRegion/fc9675e8-8db7-4eb9-a70a-d470b3cdb113/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/testWithMockedMapReduceSingleRegion=676934fe65998279aea195a434a5f309-9600b45ae9f24dbc94fb72452000bce2 2023-02-14 11:02:32,148 INFO [StoreOpener-676934fe65998279aea195a434a5f309-1] regionserver.HStore(310): Store=676934fe65998279aea195a434a5f309/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:32,148 DEBUG [Listener at localhost/36455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:32,149 INFO [Listener at localhost/36455] regionserver.HRegion(1071): Opened 676934fe65998279aea195a434a5f309; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75023068, jitterRate=0.1179308295249939}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:32,149 DEBUG [Listener at localhost/36455] regionserver.HRegion(964): Region open journal for 676934fe65998279aea195a434a5f309: 2023-02-14 11:02:32,193 DEBUG [Listener at localhost/36455] regionserver.HRegion(1603): Closing 676934fe65998279aea195a434a5f309, disabling compactions & flushes 2023-02-14 11:02:32,193 INFO [Listener at localhost/36455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,194 DEBUG [Listener at localhost/36455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,194 DEBUG [Listener at localhost/36455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. after waiting 0 ms 2023-02-14 11:02:32,194 DEBUG [Listener at localhost/36455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,194 INFO [Listener at localhost/36455] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,195 DEBUG [Listener at localhost/36455] regionserver.HRegion(1557): Region close journal for 676934fe65998279aea195a434a5f309: 2023-02-14 11:02:32,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-14 11:02:32,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,201 INFO [Listener at localhost/36455] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:32,205 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372552205"}]},"ts":"1676372552205"} 2023-02-14 11:02:32,206 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-14 11:02:32,208 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-14 11:02:32,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=676934fe65998279aea195a434a5f309, UNASSIGN}] 2023-02-14 11:02:32,210 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=676934fe65998279aea195a434a5f309, UNASSIGN 2023-02-14 11:02:32,210 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=676934fe65998279aea195a434a5f309, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,210 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676372552210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372552210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372552210"}]},"ts":"1676372552210"} 2023-02-14 11:02:32,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 676934fe65998279aea195a434a5f309, server=jenkins-hbase4.apache.org,33153,1676372549566}] 2023-02-14 11:02:32,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:32,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 676934fe65998279aea195a434a5f309 2023-02-14 11:02:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 676934fe65998279aea195a434a5f309, disabling compactions & flushes 2023-02-14 11:02:32,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. after waiting 0 ms 2023-02-14 11:02:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:32,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309. 2023-02-14 11:02:32,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 676934fe65998279aea195a434a5f309: 2023-02-14 11:02:32,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 676934fe65998279aea195a434a5f309 2023-02-14 11:02:32,369 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=676934fe65998279aea195a434a5f309, regionState=CLOSED 2023-02-14 11:02:32,370 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676372552369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372552369"}]},"ts":"1676372552369"} 2023-02-14 11:02:32,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-14 11:02:32,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 676934fe65998279aea195a434a5f309, server=jenkins-hbase4.apache.org,33153,1676372549566 in 160 msec 2023-02-14 11:02:32,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-14 11:02:32,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=676934fe65998279aea195a434a5f309, UNASSIGN in 164 msec 2023-02-14 11:02:32,374 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372552373"}]},"ts":"1676372552373"} 2023-02-14 11:02:32,374 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-14 11:02:32,376 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-14 11:02:32,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 175 msec 2023-02-14 11:02:32,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:32,509 INFO [Listener at localhost/36455] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-14 11:02:32,509 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,512 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,513 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-14 11:02:32,516 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309 2023-02-14 11:02:32,518 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1, FileablePath, hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2, FileablePath, hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/recovered.edits] 2023-02-14 11:02:32,522 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/610493a0f39a4b2eadc4d90e5a90cc77 to hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/archive/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/610493a0f39a4b2eadc4d90e5a90cc77 2023-02-14 11:02:32,523 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/d683eed8e0fe4dc68c6330893a9008c3 to hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/archive/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f1/d683eed8e0fe4dc68c6330893a9008c3 2023-02-14 11:02:32,526 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/57a810fa34284c1a86c47fcd7f03748f to hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/archive/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/57a810fa34284c1a86c47fcd7f03748f 2023-02-14 11:02:32,527 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/9600b45ae9f24dbc94fb72452000bce2 to hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/archive/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/f2/9600b45ae9f24dbc94fb72452000bce2 2023-02-14 11:02:32,530 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/recovered.edits/12.seqid to hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/archive/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309/recovered.edits/12.seqid 2023-02-14 11:02:32,530 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/.tmp/data/default/testWithMockedMapReduceSingleRegion/676934fe65998279aea195a434a5f309 2023-02-14 11:02:32,530 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-14 11:02:32,532 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,534 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-14 11:02:32,535 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-14 11:02:32,538 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,538 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-14 11:02:32,538 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372552538"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:32,540 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-14 11:02:32,540 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 676934fe65998279aea195a434a5f309, NAME => 'testWithMockedMapReduceSingleRegion,,1676372550744.676934fe65998279aea195a434a5f309.', STARTKEY => '', ENDKEY => ''}] 2023-02-14 11:02:32,540 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-14 11:02:32,540 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676372552540"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:32,541 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-14 11:02:32,543 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-14 11:02:32,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 33 msec 2023-02-14 11:02:32,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37995] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-14 11:02:32,615 INFO [Listener at localhost/36455] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-14 11:02:32,615 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-14 11:02:32,615 INFO [Listener at localhost/36455] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-14 11:02:32,615 DEBUG [Listener at localhost/36455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x433639b8 to 127.0.0.1:55750 2023-02-14 11:02:32,615 DEBUG [Listener at localhost/36455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:32,616 DEBUG [Listener at localhost/36455] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-14 11:02:32,616 DEBUG [Listener at localhost/36455] util.JVMClusterUtil(257): Found active master hash=267971006, stopped=false 2023-02-14 11:02:32,616 INFO [Listener at localhost/36455] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:32,619 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:32,619 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:32,619 INFO [Listener at localhost/36455] procedure2.ProcedureExecutor(629): Stopping 2023-02-14 11:02:32,619 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:32,619 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:32,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:32,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:32,621 DEBUG [Listener at localhost/36455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33bc51c2 to 127.0.0.1:55750 2023-02-14 11:02:32,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:32,621 DEBUG [Listener at localhost/36455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:32,621 INFO [Listener at localhost/36455] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33153,1676372549566' ***** 2023-02-14 11:02:32,621 INFO [Listener at localhost/36455] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:32,621 INFO [Listener at localhost/36455] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44655,1676372549602' ***** 2023-02-14 11:02:32,621 INFO [Listener at localhost/36455] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:32,621 INFO [RS:0;jenkins-hbase4:33153] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:32,621 INFO [RS:0;jenkins-hbase4:33153] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:32,621 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:32,621 INFO [RS:1;jenkins-hbase4:44655] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:32,621 INFO [RS:0;jenkins-hbase4:33153] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:32,622 INFO [RS:1;jenkins-hbase4:44655] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:32,622 INFO [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,622 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:32,623 DEBUG [RS:0;jenkins-hbase4:33153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ff6efc8 to 127.0.0.1:55750 2023-02-14 11:02:32,622 INFO [RS:1;jenkins-hbase4:44655] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:32,623 DEBUG [RS:0;jenkins-hbase4:33153] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:32,623 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(3304): Received CLOSE for cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:32,623 INFO [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33153,1676372549566; all regions closed. 2023-02-14 11:02:32,624 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,624 DEBUG [RS:1;jenkins-hbase4:44655] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ad4f07e to 127.0.0.1:55750 2023-02-14 11:02:32,624 DEBUG [RS:1;jenkins-hbase4:44655] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:32,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cd41501335d23a88c39b8fc8f496ee87, disabling compactions & flushes 2023-02-14 11:02:32,624 INFO [RS:1;jenkins-hbase4:44655] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:32,624 INFO [RS:1;jenkins-hbase4:44655] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:32,624 INFO [RS:1;jenkins-hbase4:44655] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:32,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:32,624 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-14 11:02:32,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:32,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. after waiting 0 ms 2023-02-14 11:02:32,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:32,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing cd41501335d23a88c39b8fc8f496ee87 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-14 11:02:32,624 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-14 11:02:32,624 DEBUG [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, cd41501335d23a88c39b8fc8f496ee87=hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87.} 2023-02-14 11:02:32,624 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:32,624 DEBUG [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1505): Waiting on 1588230740, cd41501335d23a88c39b8fc8f496ee87 2023-02-14 11:02:32,625 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:32,625 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:32,625 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:32,625 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:32,625 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-14 11:02:32,628 DEBUG [RS:0;jenkins-hbase4:33153] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/oldWALs 2023-02-14 11:02:32,628 INFO [RS:0;jenkins-hbase4:33153] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33153%2C1676372549566:(num 1676372550908) 2023-02-14 11:02:32,628 DEBUG [RS:0;jenkins-hbase4:33153] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:32,628 INFO [RS:0;jenkins-hbase4:33153] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:32,628 INFO [RS:0;jenkins-hbase4:33153] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:32,628 INFO [RS:0;jenkins-hbase4:33153] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:32,628 INFO [RS:0;jenkins-hbase4:33153] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:32,628 INFO [RS:0;jenkins-hbase4:33153] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:32,628 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:32,629 INFO [RS:0;jenkins-hbase4:33153] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33153 2023-02-14 11:02:32,631 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,631 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33153,1676372549566 2023-02-14 11:02:32,631 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:32,631 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:32,631 ERROR [Listener at localhost/36455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@350ed960 rejected from java.util.concurrent.ThreadPoolExecutor@31315b19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:32,631 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:32,632 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33153,1676372549566] 2023-02-14 11:02:32,632 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33153,1676372549566; numProcessing=1 2023-02-14 11:02:32,634 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33153,1676372549566 already deleted, retry=false 2023-02-14 11:02:32,634 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33153,1676372549566 expired; onlineServers=1 2023-02-14 11:02:32,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87/.tmp/info/c279710fac0d4fca83717ce667f5280b 2023-02-14 11:02:32,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87/.tmp/info/c279710fac0d4fca83717ce667f5280b as hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87/info/c279710fac0d4fca83717ce667f5280b 2023-02-14 11:02:32,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87/info/c279710fac0d4fca83717ce667f5280b, entries=2, sequenceid=6, filesize=4.8 K 2023-02-14 11:02:32,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cd41501335d23a88c39b8fc8f496ee87 in 20ms, sequenceid=6, compaction requested=false 2023-02-14 11:02:32,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/.tmp/info/d184f8a2ac974a8998d5ef21a0eb03a1 2023-02-14 11:02:32,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/namespace/cd41501335d23a88c39b8fc8f496ee87/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-14 11:02:32,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:32,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cd41501335d23a88c39b8fc8f496ee87: 2023-02-14 11:02:32,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676372550190.cd41501335d23a88c39b8fc8f496ee87. 2023-02-14 11:02:32,650 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d184f8a2ac974a8998d5ef21a0eb03a1 2023-02-14 11:02:32,657 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/.tmp/rep_barrier/b1b052f1330a4548ba1d50bcc2c9c79f 2023-02-14 11:02:32,661 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1b052f1330a4548ba1d50bcc2c9c79f 2023-02-14 11:02:32,667 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/.tmp/table/ce8dd7481a664667950d9748c9ec0e50 2023-02-14 11:02:32,671 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce8dd7481a664667950d9748c9ec0e50 2023-02-14 11:02:32,671 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/.tmp/info/d184f8a2ac974a8998d5ef21a0eb03a1 as hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/info/d184f8a2ac974a8998d5ef21a0eb03a1 2023-02-14 11:02:32,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d184f8a2ac974a8998d5ef21a0eb03a1 2023-02-14 11:02:32,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/info/d184f8a2ac974a8998d5ef21a0eb03a1, entries=12, sequenceid=21, filesize=6.3 K 2023-02-14 11:02:32,676 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/.tmp/rep_barrier/b1b052f1330a4548ba1d50bcc2c9c79f as hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/rep_barrier/b1b052f1330a4548ba1d50bcc2c9c79f 2023-02-14 11:02:32,680 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1b052f1330a4548ba1d50bcc2c9c79f 2023-02-14 11:02:32,680 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/rep_barrier/b1b052f1330a4548ba1d50bcc2c9c79f, entries=1, sequenceid=21, filesize=5.0 K 2023-02-14 11:02:32,680 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/.tmp/table/ce8dd7481a664667950d9748c9ec0e50 as hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/table/ce8dd7481a664667950d9748c9ec0e50 2023-02-14 11:02:32,681 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:32,685 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce8dd7481a664667950d9748c9ec0e50 2023-02-14 11:02:32,685 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/table/ce8dd7481a664667950d9748c9ec0e50, entries=4, sequenceid=21, filesize=5.1 K 2023-02-14 11:02:32,689 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:32,689 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 64ms, sequenceid=21, compaction requested=false 2023-02-14 11:02:32,693 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-14 11:02:32,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:32,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:32,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:32,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:32,819 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:32,819 INFO [RS:0;jenkins-hbase4:33153] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33153,1676372549566; zookeeper connection closed. 2023-02-14 11:02:32,819 ERROR [Listener at localhost/36455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68befcc rejected from java.util.concurrent.ThreadPoolExecutor@31315b19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:32,820 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:33153-0x100527f09400001, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:32,820 ERROR [Listener at localhost/36455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e5f818f rejected from java.util.concurrent.ThreadPoolExecutor@31315b19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:32,820 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f09cc14] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f09cc14 2023-02-14 11:02:32,825 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44655,1676372549602; all regions closed. 2023-02-14 11:02:32,832 DEBUG [RS:1;jenkins-hbase4:44655] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/oldWALs 2023-02-14 11:02:32,832 INFO [RS:1;jenkins-hbase4:44655] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44655%2C1676372549602.meta:.meta(num 1676372550137) 2023-02-14 11:02:32,836 DEBUG [RS:1;jenkins-hbase4:44655] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/oldWALs 2023-02-14 11:02:32,836 INFO [RS:1;jenkins-hbase4:44655] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44655%2C1676372549602:(num 1676372550531) 2023-02-14 11:02:32,836 DEBUG [RS:1;jenkins-hbase4:44655] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:32,836 INFO [RS:1;jenkins-hbase4:44655] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:32,836 INFO [RS:1;jenkins-hbase4:44655] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:32,836 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:32,837 INFO [RS:1;jenkins-hbase4:44655] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44655 2023-02-14 11:02:32,840 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44655,1676372549602 2023-02-14 11:02:32,840 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:32,840 ERROR [Listener at localhost/36455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7002dc3e rejected from java.util.concurrent.ThreadPoolExecutor@743d56e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:32,841 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44655,1676372549602] 2023-02-14 11:02:32,841 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44655,1676372549602; numProcessing=2 2023-02-14 11:02:32,842 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44655,1676372549602 already deleted, retry=false 2023-02-14 11:02:32,842 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44655,1676372549602 expired; onlineServers=0 2023-02-14 11:02:32,842 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37995,1676372549520' ***** 2023-02-14 11:02:32,842 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-14 11:02:32,843 DEBUG [M:0;jenkins-hbase4:37995] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bc77c99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:32,843 INFO [M:0;jenkins-hbase4:37995] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37995,1676372549520 2023-02-14 11:02:32,843 INFO [M:0;jenkins-hbase4:37995] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37995,1676372549520; all regions closed. 2023-02-14 11:02:32,843 DEBUG [M:0;jenkins-hbase4:37995] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:32,843 DEBUG [M:0;jenkins-hbase4:37995] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-14 11:02:32,843 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-14 11:02:32,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372549781] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372549781,5,FailOnTimeoutGroup] 2023-02-14 11:02:32,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372549780] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372549780,5,FailOnTimeoutGroup] 2023-02-14 11:02:32,843 DEBUG [M:0;jenkins-hbase4:37995] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-14 11:02:32,845 INFO [M:0;jenkins-hbase4:37995] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-14 11:02:32,845 INFO [M:0;jenkins-hbase4:37995] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-14 11:02:32,845 INFO [M:0;jenkins-hbase4:37995] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-14 11:02:32,845 DEBUG [M:0;jenkins-hbase4:37995] master.HMaster(1512): Stopping service threads 2023-02-14 11:02:32,845 INFO [M:0;jenkins-hbase4:37995] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-14 11:02:32,846 ERROR [M:0;jenkins-hbase4:37995] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-14 11:02:32,846 INFO [M:0;jenkins-hbase4:37995] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-14 11:02:32,846 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-14 11:02:32,846 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:32,846 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:32,846 DEBUG [M:0;jenkins-hbase4:37995] zookeeper.ZKUtil(398): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-14 11:02:32,846 WARN [M:0;jenkins-hbase4:37995] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-14 11:02:32,846 INFO [M:0;jenkins-hbase4:37995] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-14 11:02:32,847 INFO [M:0;jenkins-hbase4:37995] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-14 11:02:32,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:32,847 DEBUG [M:0;jenkins-hbase4:37995] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:32,847 INFO [M:0;jenkins-hbase4:37995] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:32,847 DEBUG [M:0;jenkins-hbase4:37995] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:32,847 DEBUG [M:0;jenkins-hbase4:37995] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:32,847 DEBUG [M:0;jenkins-hbase4:37995] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:32,847 INFO [M:0;jenkins-hbase4:37995] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.15 KB heapSize=67.07 KB 2023-02-14 11:02:32,863 INFO [M:0;jenkins-hbase4:37995] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.15 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9b97a98c9bd542b99c53a0b9ea52018b 2023-02-14 11:02:32,867 DEBUG [M:0;jenkins-hbase4:37995] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9b97a98c9bd542b99c53a0b9ea52018b as hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9b97a98c9bd542b99c53a0b9ea52018b 2023-02-14 11:02:32,872 INFO [M:0;jenkins-hbase4:37995] regionserver.HStore(1080): Added hdfs://localhost:44743/user/jenkins/test-data/044c618f-66be-a387-08bf-af4129eb8ef8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9b97a98c9bd542b99c53a0b9ea52018b, entries=17, sequenceid=132, filesize=8.7 K 2023-02-14 11:02:32,873 INFO [M:0;jenkins-hbase4:37995] regionserver.HRegion(2947): Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=132, compaction requested=false 2023-02-14 11:02:32,873 INFO [M:0;jenkins-hbase4:37995] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:32,873 DEBUG [M:0;jenkins-hbase4:37995] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:32,876 INFO [M:0;jenkins-hbase4:37995] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-14 11:02:32,876 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:32,877 INFO [M:0;jenkins-hbase4:37995] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37995 2023-02-14 11:02:32,880 DEBUG [M:0;jenkins-hbase4:37995] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37995,1676372549520 already deleted, retry=false 2023-02-14 11:02:33,222 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:33,222 INFO [M:0;jenkins-hbase4:37995] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37995,1676372549520; zookeeper connection closed. 2023-02-14 11:02:33,222 ERROR [Listener at localhost/36455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2379d9c6 rejected from java.util.concurrent.ThreadPoolExecutor@27464971[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:33,223 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): master:37995-0x100527f09400000, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:33,224 ERROR [Listener at localhost/36455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e364b9e rejected from java.util.concurrent.ThreadPoolExecutor@27464971[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:33,324 INFO [RS:1;jenkins-hbase4:44655] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44655,1676372549602; zookeeper connection closed. 2023-02-14 11:02:33,324 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:33,324 ERROR [Listener at localhost/36455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66c17439 rejected from java.util.concurrent.ThreadPoolExecutor@743d56e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:33,324 DEBUG [Listener at localhost/36455-EventThread] zookeeper.ZKWatcher(600): regionserver:44655-0x100527f09400002, quorum=127.0.0.1:55750, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:33,324 ERROR [Listener at localhost/36455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e505b7b rejected from java.util.concurrent.ThreadPoolExecutor@743d56e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:33,325 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@73c18fb7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@73c18fb7 2023-02-14 11:02:33,325 INFO [Listener at localhost/36455] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-14 11:02:33,325 WARN [Listener at localhost/36455] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:33,328 INFO [Listener at localhost/36455] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:33,431 WARN [BP-149827024-172.31.14.131-1676372548906 heartbeating to localhost/127.0.0.1:44743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:33,431 WARN [BP-149827024-172.31.14.131-1676372548906 heartbeating to localhost/127.0.0.1:44743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-149827024-172.31.14.131-1676372548906 (Datanode Uuid 65de1072-5e39-4416-bb37-7b26879ef18c) service to localhost/127.0.0.1:44743 2023-02-14 11:02:33,432 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/cluster_59175c2f-068c-c3d6-c489-d97e62c9344b/dfs/data/data3/current/BP-149827024-172.31.14.131-1676372548906] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:33,432 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/cluster_59175c2f-068c-c3d6-c489-d97e62c9344b/dfs/data/data4/current/BP-149827024-172.31.14.131-1676372548906] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:33,434 WARN [Listener at localhost/36455] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:33,439 INFO [Listener at localhost/36455] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:33,543 WARN [BP-149827024-172.31.14.131-1676372548906 heartbeating to localhost/127.0.0.1:44743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:33,543 WARN [BP-149827024-172.31.14.131-1676372548906 heartbeating to localhost/127.0.0.1:44743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-149827024-172.31.14.131-1676372548906 (Datanode Uuid a733bcda-45ca-4408-b332-35b134c5a68b) service to localhost/127.0.0.1:44743 2023-02-14 11:02:33,544 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/cluster_59175c2f-068c-c3d6-c489-d97e62c9344b/dfs/data/data1/current/BP-149827024-172.31.14.131-1676372548906] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:33,544 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/cluster_59175c2f-068c-c3d6-c489-d97e62c9344b/dfs/data/data2/current/BP-149827024-172.31.14.131-1676372548906] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:33,556 INFO [Listener at localhost/36455] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:33,673 INFO [Listener at localhost/36455] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-14 11:02:33,691 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-14 11:02:33,705 INFO [Listener at localhost/36455] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 230) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:44743 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36455 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37995,1676372549520)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:44743 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:44743 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:44743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:44743 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:44743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44743 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=652 (was 635) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=270 (was 267) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5595 (was 5628) 2023-02-14 11:02:33,718 INFO [Listener at localhost/36455] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=270, ProcessCount=168, AvailableMemoryMB=5595 2023-02-14 11:02:33,732 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/hadoop.log.dir so I do NOT create it in target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b 2023-02-14 11:02:33,732 WARN [Listener at localhost/36455] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/hadoop.log.dir Erasing configuration value by system value. 2023-02-14 11:02:33,732 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/hadoop.tmp.dir so I do NOT create it in target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b 2023-02-14 11:02:33,732 WARN [Listener at localhost/36455] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a4286e2-8667-f53c-9c19-8b5f63f243b9/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-14 11:02:33,732 DEBUG [Listener at localhost/36455] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b 2023-02-14 11:02:33,732 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-14 11:02:33,732 INFO [Listener at localhost/36455] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/cluster_58b5c76c-031a-1e78-4470-e4bf549615ce, deleteOnExit=true 2023-02-14 11:02:33,733 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-14 11:02:33,733 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/test.cache.data in system properties and HBase conf 2023-02-14 11:02:33,733 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/hadoop.tmp.dir in system properties and HBase conf 2023-02-14 11:02:33,733 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/hadoop.log.dir in system properties and HBase conf 2023-02-14 11:02:33,733 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-14 11:02:33,733 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-14 11:02:33,733 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-14 11:02:33,733 DEBUG [Listener at localhost/36455] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-14 11:02:33,733 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/nfs.dump.dir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/java.io.tmpdir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:33,734 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-14 11:02:33,735 INFO [Listener at localhost/36455] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-14 11:02:33,739 WARN [Listener at localhost/36455] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:33,739 WARN [Listener at localhost/36455] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:33,787 WARN [Listener at localhost/36455] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:33,789 INFO [Listener at localhost/36455] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:33,797 INFO [Listener at localhost/36455] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/java.io.tmpdir/Jetty_localhost_41911_hdfs____u7f86e/webapp 2023-02-14 11:02:33,896 INFO [Listener at localhost/36455] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41911 2023-02-14 11:02:33,900 WARN [Listener at localhost/36455] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:33,900 WARN [Listener at localhost/36455] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:33,939 WARN [Listener at localhost/42869] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:33,952 WARN [Listener at localhost/42869] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:33,954 WARN [Listener at localhost/42869] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:33,955 INFO [Listener at localhost/42869] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:33,961 INFO [Listener at localhost/42869] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/java.io.tmpdir/Jetty_localhost_38905_datanode____.iq01sw/webapp 2023-02-14 11:02:34,056 INFO [Listener at localhost/42869] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38905 2023-02-14 11:02:34,068 WARN [Listener at localhost/44885] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:34,084 WARN [Listener at localhost/44885] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:34,086 WARN [Listener at localhost/44885] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:34,087 INFO [Listener at localhost/44885] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:34,091 INFO [Listener at localhost/44885] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/java.io.tmpdir/Jetty_localhost_40525_datanode____psa9er/webapp 2023-02-14 11:02:34,180 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x50f9fa32b072d3f: Processing first storage report for DS-599634c2-fba7-420e-86c8-ebb4f2fc191e from datanode 18107fbb-bd49-4853-bac3-34feb9a5d3ed 2023-02-14 11:02:34,180 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x50f9fa32b072d3f: from storage DS-599634c2-fba7-420e-86c8-ebb4f2fc191e node DatanodeRegistration(127.0.0.1:40819, datanodeUuid=18107fbb-bd49-4853-bac3-34feb9a5d3ed, infoPort=34101, infoSecurePort=0, ipcPort=44885, storageInfo=lv=-57;cid=testClusterID;nsid=1485929718;c=1676372553741), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:34,180 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x50f9fa32b072d3f: Processing first storage report for DS-3da2793c-05dc-4303-88bd-0f387322f5a1 from datanode 18107fbb-bd49-4853-bac3-34feb9a5d3ed 2023-02-14 11:02:34,180 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x50f9fa32b072d3f: from storage DS-3da2793c-05dc-4303-88bd-0f387322f5a1 node DatanodeRegistration(127.0.0.1:40819, datanodeUuid=18107fbb-bd49-4853-bac3-34feb9a5d3ed, infoPort=34101, infoSecurePort=0, ipcPort=44885, storageInfo=lv=-57;cid=testClusterID;nsid=1485929718;c=1676372553741), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:34,194 INFO [Listener at localhost/44885] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40525 2023-02-14 11:02:34,201 WARN [Listener at localhost/41179] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:34,300 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ba3d52d738c64b4: Processing first storage report for DS-1f9a2642-14b0-491d-b064-1e03b26681c2 from datanode c378ab06-ef27-49e9-acda-ae6a2c2464a4 2023-02-14 11:02:34,300 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ba3d52d738c64b4: from storage DS-1f9a2642-14b0-491d-b064-1e03b26681c2 node DatanodeRegistration(127.0.0.1:45447, datanodeUuid=c378ab06-ef27-49e9-acda-ae6a2c2464a4, infoPort=38097, infoSecurePort=0, ipcPort=41179, storageInfo=lv=-57;cid=testClusterID;nsid=1485929718;c=1676372553741), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:34,300 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ba3d52d738c64b4: Processing first storage report for DS-cd2a9ad7-9f49-4431-b539-585ba2c299c8 from datanode c378ab06-ef27-49e9-acda-ae6a2c2464a4 2023-02-14 11:02:34,300 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ba3d52d738c64b4: from storage DS-cd2a9ad7-9f49-4431-b539-585ba2c299c8 node DatanodeRegistration(127.0.0.1:45447, datanodeUuid=c378ab06-ef27-49e9-acda-ae6a2c2464a4, infoPort=38097, infoSecurePort=0, ipcPort=41179, storageInfo=lv=-57;cid=testClusterID;nsid=1485929718;c=1676372553741), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:34,307 DEBUG [Listener at localhost/41179] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b 2023-02-14 11:02:34,309 INFO [Listener at localhost/41179] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/cluster_58b5c76c-031a-1e78-4470-e4bf549615ce/zookeeper_0, clientPort=64284, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/cluster_58b5c76c-031a-1e78-4470-e4bf549615ce/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/cluster_58b5c76c-031a-1e78-4470-e4bf549615ce/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-14 11:02:34,310 INFO [Listener at localhost/41179] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64284 2023-02-14 11:02:34,311 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,311 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,327 INFO [Listener at localhost/41179] util.FSUtils(479): Created version file at hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042 with version=8 2023-02-14 11:02:34,328 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,328 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,329 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42869/user/jenkins/test-data/939015f2-a99c-8e4e-90b3-33a781b5ef20/hbase-staging 2023-02-14 11:02:34,331 INFO [Listener at localhost/41179] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:34,331 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:34,331 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:34,332 INFO [Listener at localhost/41179] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:34,332 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:34,332 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:34,332 INFO [Listener at localhost/41179] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:34,333 INFO [Listener at localhost/41179] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46203 2023-02-14 11:02:34,333 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,334 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,335 INFO [Listener at localhost/41179] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46203 connecting to ZooKeeper ensemble=127.0.0.1:64284 2023-02-14 11:02:34,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:462030x0, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:34,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46203-0x100527f1c0a0000 connected 2023-02-14 11:02:34,373 DEBUG [Listener at localhost/41179] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:34,373 DEBUG [Listener at localhost/41179] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:34,374 DEBUG [Listener at localhost/41179] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:34,374 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46203 2023-02-14 11:02:34,374 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46203 2023-02-14 11:02:34,375 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46203 2023-02-14 11:02:34,375 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46203 2023-02-14 11:02:34,375 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46203 2023-02-14 11:02:34,375 INFO [Listener at localhost/41179] master.HMaster(444): hbase.rootdir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042, hbase.cluster.distributed=false 2023-02-14 11:02:34,389 INFO [Listener at localhost/41179] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:34,389 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:34,389 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:34,389 INFO [Listener at localhost/41179] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:34,389 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:34,389 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:34,389 INFO [Listener at localhost/41179] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:34,390 INFO [Listener at localhost/41179] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45617 2023-02-14 11:02:34,390 INFO [Listener at localhost/41179] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:34,391 DEBUG [Listener at localhost/41179] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:34,391 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,392 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,393 INFO [Listener at localhost/41179] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45617 connecting to ZooKeeper ensemble=127.0.0.1:64284 2023-02-14 11:02:34,397 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:456170x0, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:34,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45617-0x100527f1c0a0001 connected 2023-02-14 11:02:34,398 DEBUG [Listener at localhost/41179] zookeeper.ZKUtil(164): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:34,399 DEBUG [Listener at localhost/41179] zookeeper.ZKUtil(164): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:34,399 DEBUG [Listener at localhost/41179] zookeeper.ZKUtil(164): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:34,400 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45617 2023-02-14 11:02:34,400 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45617 2023-02-14 11:02:34,400 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45617 2023-02-14 11:02:34,402 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45617 2023-02-14 11:02:34,402 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45617 2023-02-14 11:02:34,413 INFO [Listener at localhost/41179] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:34,413 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:34,413 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:34,413 INFO [Listener at localhost/41179] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:34,414 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:34,414 INFO [Listener at localhost/41179] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:34,414 INFO [Listener at localhost/41179] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:34,416 INFO [Listener at localhost/41179] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40521 2023-02-14 11:02:34,416 INFO [Listener at localhost/41179] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:34,417 DEBUG [Listener at localhost/41179] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:34,417 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,418 INFO [Listener at localhost/41179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,419 INFO [Listener at localhost/41179] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40521 connecting to ZooKeeper ensemble=127.0.0.1:64284 2023-02-14 11:02:34,421 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:405210x0, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:34,421 DEBUG [Listener at localhost/41179] zookeeper.ZKUtil(164): regionserver:405210x0, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:34,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40521-0x100527f1c0a0002 connected 2023-02-14 11:02:34,422 DEBUG [Listener at localhost/41179] zookeeper.ZKUtil(164): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:34,423 DEBUG [Listener at localhost/41179] zookeeper.ZKUtil(164): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:34,423 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40521 2023-02-14 11:02:34,423 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40521 2023-02-14 11:02:34,424 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40521 2023-02-14 11:02:34,428 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40521 2023-02-14 11:02:34,428 DEBUG [Listener at localhost/41179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40521 2023-02-14 11:02:34,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:34,431 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:34,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:34,433 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:34,433 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:34,433 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:34,433 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:34,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:34,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46203,1676372554331 from backup master directory 2023-02-14 11:02:34,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:34,438 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:34,438 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:34,438 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:34,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:34,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/hbase.id with ID: 2261d10a-4f5a-4626-a489-e3071045b862 2023-02-14 11:02:34,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:34,461 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:34,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3d01bccb to 127.0.0.1:64284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:34,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f8f5fa3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:34,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:34,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-14 11:02:34,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:34,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/data/master/store-tmp 2023-02-14 11:02:34,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:34,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:34,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:34,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:34,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:34,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:34,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:34,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:34,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/WALs/jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:34,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46203%2C1676372554331, suffix=, logDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/WALs/jenkins-hbase4.apache.org,46203,1676372554331, archiveDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/oldWALs, maxLogs=10 2023-02-14 11:02:34,537 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45447,DS-1f9a2642-14b0-491d-b064-1e03b26681c2,DISK] 2023-02-14 11:02:34,538 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40819,DS-599634c2-fba7-420e-86c8-ebb4f2fc191e,DISK] 2023-02-14 11:02:34,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/WALs/jenkins-hbase4.apache.org,46203,1676372554331/jenkins-hbase4.apache.org%2C46203%2C1676372554331.1676372554484 2023-02-14 11:02:34,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45447,DS-1f9a2642-14b0-491d-b064-1e03b26681c2,DISK], DatanodeInfoWithStorage[127.0.0.1:40819,DS-599634c2-fba7-420e-86c8-ebb4f2fc191e,DISK]] 2023-02-14 11:02:34,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:34,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:34,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:34,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:34,542 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:34,544 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-14 11:02:34,544 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-14 11:02:34,545 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:34,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:34,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:34,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:34,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:34,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60905946, jitterRate=-0.09243068099021912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:34,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:34,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-14 11:02:34,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-14 11:02:34,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-14 11:02:34,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-14 11:02:34,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-14 11:02:34,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-14 11:02:34,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-14 11:02:34,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-14 11:02:34,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-14 11:02:34,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-14 11:02:34,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-14 11:02:34,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-14 11:02:34,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-14 11:02:34,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-14 11:02:34,566 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:34,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-14 11:02:34,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-14 11:02:34,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-14 11:02:34,569 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:34,569 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:34,569 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:34,569 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:34,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46203,1676372554331, sessionid=0x100527f1c0a0000, setting cluster-up flag (Was=false) 2023-02-14 11:02:34,574 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:34,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-14 11:02:34,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:34,581 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:34,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-14 11:02:34,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:34,585 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.hbase-snapshot/.tmp 2023-02-14 11:02:34,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:34,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:34,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:34,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:34,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:34,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-14 11:02:34,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:34,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676372584589 2023-02-14 11:02:34,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-14 11:02:34,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-14 11:02:34,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-14 11:02:34,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-14 11:02:34,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-14 11:02:34,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-14 11:02:34,590 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:34,590 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-14 11:02:34,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-14 11:02:34,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-14 11:02:34,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-14 11:02:34,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-14 11:02:34,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-14 11:02:34,591 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:34,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372554591,5,FailOnTimeoutGroup] 2023-02-14 11:02:34,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372554592,5,FailOnTimeoutGroup] 2023-02-14 11:02:34,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-14 11:02:34,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,602 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:34,603 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:34,603 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042 2023-02-14 11:02:34,612 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:34,613 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:34,614 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/info 2023-02-14 11:02:34,614 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:34,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:34,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:34,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:34,616 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:34,616 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:34,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:34,617 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/table 2023-02-14 11:02:34,618 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:34,618 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:34,619 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740 2023-02-14 11:02:34,619 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740 2023-02-14 11:02:34,620 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:34,621 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:34,623 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:34,623 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70788026, jitterRate=0.05482378602027893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:34,623 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:34,623 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:34,623 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:34,623 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:34,623 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:34,623 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:34,624 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:34,624 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:34,624 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:34,624 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-14 11:02:34,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-14 11:02:34,626 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-14 11:02:34,627 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-14 11:02:34,636 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(952): ClusterId : 2261d10a-4f5a-4626-a489-e3071045b862 2023-02-14 11:02:34,636 INFO [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(952): ClusterId : 2261d10a-4f5a-4626-a489-e3071045b862 2023-02-14 11:02:34,636 DEBUG [RS:0;jenkins-hbase4:45617] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:34,636 DEBUG [RS:1;jenkins-hbase4:40521] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:34,639 DEBUG [RS:0;jenkins-hbase4:45617] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:34,639 DEBUG [RS:1;jenkins-hbase4:40521] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:34,639 DEBUG [RS:1;jenkins-hbase4:40521] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:34,639 DEBUG [RS:0;jenkins-hbase4:45617] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:34,641 DEBUG [RS:1;jenkins-hbase4:40521] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:34,642 DEBUG [RS:1;jenkins-hbase4:40521] zookeeper.ReadOnlyZKClient(139): Connect 0x2ddaf089 to 127.0.0.1:64284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:34,642 DEBUG [RS:0;jenkins-hbase4:45617] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:34,642 DEBUG [RS:0;jenkins-hbase4:45617] zookeeper.ReadOnlyZKClient(139): Connect 0x11671a7c to 127.0.0.1:64284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:34,647 DEBUG [RS:1;jenkins-hbase4:40521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@231d1b42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:34,647 DEBUG [RS:0;jenkins-hbase4:45617] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fa0e620, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:34,647 DEBUG [RS:1;jenkins-hbase4:40521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27229bf9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:34,647 DEBUG [RS:0;jenkins-hbase4:45617] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b9f710c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:34,655 DEBUG [RS:1;jenkins-hbase4:40521] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40521 2023-02-14 11:02:34,656 INFO [RS:1;jenkins-hbase4:40521] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:34,656 INFO [RS:1;jenkins-hbase4:40521] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:34,656 DEBUG [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:34,656 INFO [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46203,1676372554331 with isa=jenkins-hbase4.apache.org/172.31.14.131:40521, startcode=1676372554413 2023-02-14 11:02:34,656 DEBUG [RS:1;jenkins-hbase4:40521] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:34,658 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59523, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:34,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:34,660 DEBUG [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042 2023-02-14 11:02:34,660 DEBUG [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42869 2023-02-14 11:02:34,660 DEBUG [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:34,660 DEBUG [RS:0;jenkins-hbase4:45617] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45617 2023-02-14 11:02:34,660 INFO [RS:0;jenkins-hbase4:45617] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:34,660 INFO [RS:0;jenkins-hbase4:45617] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:34,660 DEBUG [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:34,661 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:34,661 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46203,1676372554331 with isa=jenkins-hbase4.apache.org/172.31.14.131:45617, startcode=1676372554388 2023-02-14 11:02:34,661 DEBUG [RS:1;jenkins-hbase4:40521] zookeeper.ZKUtil(162): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:34,661 DEBUG [RS:0;jenkins-hbase4:45617] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:34,661 WARN [RS:1;jenkins-hbase4:40521] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:34,662 INFO [RS:1;jenkins-hbase4:40521] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:34,662 DEBUG [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/WALs/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:34,662 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40521,1676372554413] 2023-02-14 11:02:34,669 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54565, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:34,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:34,670 DEBUG [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042 2023-02-14 11:02:34,670 DEBUG [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42869 2023-02-14 11:02:34,670 DEBUG [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:34,670 DEBUG [RS:1;jenkins-hbase4:40521] zookeeper.ZKUtil(162): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:34,674 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:34,674 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:34,674 DEBUG [RS:0;jenkins-hbase4:45617] zookeeper.ZKUtil(162): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:34,674 WARN [RS:0;jenkins-hbase4:45617] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:34,674 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45617,1676372554388] 2023-02-14 11:02:34,674 INFO [RS:0;jenkins-hbase4:45617] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:34,674 DEBUG [RS:1;jenkins-hbase4:40521] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:34,674 DEBUG [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/WALs/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:34,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:34,674 INFO [RS:1;jenkins-hbase4:40521] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:34,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:34,676 INFO [RS:1;jenkins-hbase4:40521] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:34,677 INFO [RS:1;jenkins-hbase4:40521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:34,677 INFO [RS:1;jenkins-hbase4:40521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,680 INFO [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:34,681 INFO [RS:1;jenkins-hbase4:40521] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,682 DEBUG [RS:0;jenkins-hbase4:45617] zookeeper.ZKUtil(162): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,682 DEBUG [RS:1;jenkins-hbase4:40521] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,683 DEBUG [RS:0;jenkins-hbase4:45617] zookeeper.ZKUtil(162): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:34,683 INFO [RS:1;jenkins-hbase4:40521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,683 INFO [RS:1;jenkins-hbase4:40521] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,684 INFO [RS:1;jenkins-hbase4:40521] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,684 DEBUG [RS:0;jenkins-hbase4:45617] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:34,684 INFO [RS:0;jenkins-hbase4:45617] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:34,689 INFO [RS:0;jenkins-hbase4:45617] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:34,689 INFO [RS:0;jenkins-hbase4:45617] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:34,689 INFO [RS:0;jenkins-hbase4:45617] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,689 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:34,690 INFO [RS:0;jenkins-hbase4:45617] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,691 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,691 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,691 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,691 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,691 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,691 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:34,691 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,691 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,691 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,692 DEBUG [RS:0;jenkins-hbase4:45617] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:34,696 INFO [RS:0;jenkins-hbase4:45617] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,696 INFO [RS:0;jenkins-hbase4:45617] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,696 INFO [RS:0;jenkins-hbase4:45617] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,701 INFO [RS:1;jenkins-hbase4:40521] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:34,702 INFO [RS:1;jenkins-hbase4:40521] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40521,1676372554413-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,707 INFO [RS:0;jenkins-hbase4:45617] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:34,708 INFO [RS:0;jenkins-hbase4:45617] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45617,1676372554388-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,720 INFO [RS:0;jenkins-hbase4:45617] regionserver.Replication(203): jenkins-hbase4.apache.org,45617,1676372554388 started 2023-02-14 11:02:34,720 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45617,1676372554388, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45617, sessionid=0x100527f1c0a0001 2023-02-14 11:02:34,720 INFO [RS:1;jenkins-hbase4:40521] regionserver.Replication(203): jenkins-hbase4.apache.org,40521,1676372554413 started 2023-02-14 11:02:34,720 DEBUG [RS:0;jenkins-hbase4:45617] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:34,720 DEBUG [RS:0;jenkins-hbase4:45617] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:34,720 DEBUG [RS:0;jenkins-hbase4:45617] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45617,1676372554388' 2023-02-14 11:02:34,720 DEBUG [RS:0;jenkins-hbase4:45617] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:34,720 INFO [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40521,1676372554413, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40521, sessionid=0x100527f1c0a0002 2023-02-14 11:02:34,720 DEBUG [RS:1;jenkins-hbase4:40521] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:34,720 DEBUG [RS:1;jenkins-hbase4:40521] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:34,720 DEBUG [RS:1;jenkins-hbase4:40521] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40521,1676372554413' 2023-02-14 11:02:34,720 DEBUG [RS:1;jenkins-hbase4:40521] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:34,720 DEBUG [RS:0;jenkins-hbase4:45617] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:34,721 DEBUG [RS:1;jenkins-hbase4:40521] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:34,721 DEBUG [RS:0;jenkins-hbase4:45617] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:34,721 DEBUG [RS:0;jenkins-hbase4:45617] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:34,721 DEBUG [RS:0;jenkins-hbase4:45617] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:34,721 DEBUG [RS:0;jenkins-hbase4:45617] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45617,1676372554388' 2023-02-14 11:02:34,721 DEBUG [RS:0;jenkins-hbase4:45617] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:34,721 DEBUG [RS:1;jenkins-hbase4:40521] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:34,721 DEBUG [RS:1;jenkins-hbase4:40521] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:34,721 DEBUG [RS:1;jenkins-hbase4:40521] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:34,721 DEBUG [RS:1;jenkins-hbase4:40521] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40521,1676372554413' 2023-02-14 11:02:34,721 DEBUG [RS:1;jenkins-hbase4:40521] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:34,721 DEBUG [RS:0;jenkins-hbase4:45617] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:34,721 DEBUG [RS:1;jenkins-hbase4:40521] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:34,721 DEBUG [RS:0;jenkins-hbase4:45617] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:34,722 DEBUG [RS:1;jenkins-hbase4:40521] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:34,722 INFO [RS:0;jenkins-hbase4:45617] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:34,722 INFO [RS:0;jenkins-hbase4:45617] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:34,722 INFO [RS:1;jenkins-hbase4:40521] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:34,722 INFO [RS:1;jenkins-hbase4:40521] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:34,777 DEBUG [jenkins-hbase4:46203] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-14 11:02:34,777 DEBUG [jenkins-hbase4:46203] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:34,779 DEBUG [jenkins-hbase4:46203] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:34,779 DEBUG [jenkins-hbase4:46203] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:34,779 DEBUG [jenkins-hbase4:46203] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:34,779 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45617,1676372554388, state=OPENING 2023-02-14 11:02:34,780 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-14 11:02:34,782 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:34,782 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:34,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45617,1676372554388}] 2023-02-14 11:02:34,937 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:34,937 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:34,939 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52566, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:34,942 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-14 11:02:34,942 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:34,943 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45617%2C1676372554388.meta, suffix=.meta, logDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/WALs/jenkins-hbase4.apache.org,45617,1676372554388, archiveDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/oldWALs, maxLogs=32 2023-02-14 11:02:34,956 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40819,DS-599634c2-fba7-420e-86c8-ebb4f2fc191e,DISK] 2023-02-14 11:02:34,956 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45447,DS-1f9a2642-14b0-491d-b064-1e03b26681c2,DISK] 2023-02-14 11:02:34,958 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/WALs/jenkins-hbase4.apache.org,45617,1676372554388/jenkins-hbase4.apache.org%2C45617%2C1676372554388.meta.1676372554944.meta 2023-02-14 11:02:34,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40819,DS-599634c2-fba7-420e-86c8-ebb4f2fc191e,DISK], DatanodeInfoWithStorage[127.0.0.1:45447,DS-1f9a2642-14b0-491d-b064-1e03b26681c2,DISK]] 2023-02-14 11:02:34,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:34,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-14 11:02:34,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-14 11:02:34,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-14 11:02:34,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-14 11:02:34,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:34,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-14 11:02:34,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-14 11:02:34,960 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:34,961 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/info 2023-02-14 11:02:34,961 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/info 2023-02-14 11:02:34,961 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:34,961 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:34,962 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:34,962 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:34,962 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:34,962 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:34,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:34,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:34,964 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/table 2023-02-14 11:02:34,964 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/table 2023-02-14 11:02:34,964 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:34,964 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:34,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740 2023-02-14 11:02:34,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740 2023-02-14 11:02:34,967 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:34,968 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:34,968 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66966133, jitterRate=-0.00212685763835907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:34,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:34,969 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676372554937 2023-02-14 11:02:34,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-14 11:02:34,973 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-14 11:02:34,973 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45617,1676372554388, state=OPEN 2023-02-14 11:02:34,974 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-14 11:02:34,974 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:34,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-14 11:02:34,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45617,1676372554388 in 192 msec 2023-02-14 11:02:34,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-14 11:02:34,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-14 11:02:34,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-14 11:02:34,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676372554978, completionTime=-1 2023-02-14 11:02:34,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-14 11:02:34,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-14 11:02:34,980 DEBUG [hconnection-0x52b82f5b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:34,982 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52576, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:34,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-14 11:02:34,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676372614983 2023-02-14 11:02:34,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676372674983 2023-02-14 11:02:34,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-14 11:02:34,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46203,1676372554331-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46203,1676372554331-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46203,1676372554331-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46203, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:34,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-14 11:02:34,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:34,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-14 11:02:34,992 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-14 11:02:34,992 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:34,993 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:34,994 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:34,994 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e empty. 2023-02-14 11:02:34,995 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:34,995 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-14 11:02:35,003 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:35,004 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => edfe6fa82233a4c34cd9586ccba54c2e, NAME => 'hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp 2023-02-14 11:02:35,014 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:35,014 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing edfe6fa82233a4c34cd9586ccba54c2e, disabling compactions & flushes 2023-02-14 11:02:35,014 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:35,014 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:35,014 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. after waiting 0 ms 2023-02-14 11:02:35,014 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:35,014 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:35,014 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for edfe6fa82233a4c34cd9586ccba54c2e: 2023-02-14 11:02:35,016 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:35,017 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372555017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372555017"}]},"ts":"1676372555017"} 2023-02-14 11:02:35,018 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:35,019 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:35,019 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372555019"}]},"ts":"1676372555019"} 2023-02-14 11:02:35,020 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-14 11:02:35,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:35,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:35,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:35,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:35,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=edfe6fa82233a4c34cd9586ccba54c2e, ASSIGN}] 2023-02-14 11:02:35,026 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=edfe6fa82233a4c34cd9586ccba54c2e, ASSIGN 2023-02-14 11:02:35,026 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=edfe6fa82233a4c34cd9586ccba54c2e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45617,1676372554388; forceNewPlan=false, retain=false 2023-02-14 11:02:35,177 INFO [jenkins-hbase4:46203] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:35,177 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=edfe6fa82233a4c34cd9586ccba54c2e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:35,177 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372555177"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372555177"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372555177"}]},"ts":"1676372555177"} 2023-02-14 11:02:35,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure edfe6fa82233a4c34cd9586ccba54c2e, server=jenkins-hbase4.apache.org,45617,1676372554388}] 2023-02-14 11:02:35,334 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:35,335 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45617%2C1676372554388, suffix=, logDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/WALs/jenkins-hbase4.apache.org,45617,1676372554388, archiveDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/oldWALs, maxLogs=32 2023-02-14 11:02:35,348 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45447,DS-1f9a2642-14b0-491d-b064-1e03b26681c2,DISK] 2023-02-14 11:02:35,348 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40819,DS-599634c2-fba7-420e-86c8-ebb4f2fc191e,DISK] 2023-02-14 11:02:35,350 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/WALs/jenkins-hbase4.apache.org,45617,1676372554388/jenkins-hbase4.apache.org%2C45617%2C1676372554388.1676372555336 2023-02-14 11:02:35,350 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45447,DS-1f9a2642-14b0-491d-b064-1e03b26681c2,DISK], DatanodeInfoWithStorage[127.0.0.1:40819,DS-599634c2-fba7-420e-86c8-ebb4f2fc191e,DISK]] 2023-02-14 11:02:35,350 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => edfe6fa82233a4c34cd9586ccba54c2e, NAME => 'hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:35,351 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:35,351 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:35,351 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:35,351 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:35,354 INFO [StoreOpener-edfe6fa82233a4c34cd9586ccba54c2e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:35,355 DEBUG [StoreOpener-edfe6fa82233a4c34cd9586ccba54c2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e/info 2023-02-14 11:02:35,355 DEBUG [StoreOpener-edfe6fa82233a4c34cd9586ccba54c2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e/info 2023-02-14 11:02:35,356 INFO [StoreOpener-edfe6fa82233a4c34cd9586ccba54c2e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region edfe6fa82233a4c34cd9586ccba54c2e columnFamilyName info 2023-02-14 11:02:35,356 INFO [StoreOpener-edfe6fa82233a4c34cd9586ccba54c2e-1] regionserver.HStore(310): Store=edfe6fa82233a4c34cd9586ccba54c2e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:35,357 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:35,357 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:35,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:35,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:35,361 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened edfe6fa82233a4c34cd9586ccba54c2e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61240742, jitterRate=-0.0874418318271637}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:35,361 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for edfe6fa82233a4c34cd9586ccba54c2e: 2023-02-14 11:02:35,362 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e., pid=6, masterSystemTime=1676372555330 2023-02-14 11:02:35,363 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:35,363 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:35,363 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=edfe6fa82233a4c34cd9586ccba54c2e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:35,364 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372555363"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372555363"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372555363"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372555363"}]},"ts":"1676372555363"} 2023-02-14 11:02:35,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-14 11:02:35,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure edfe6fa82233a4c34cd9586ccba54c2e, server=jenkins-hbase4.apache.org,45617,1676372554388 in 186 msec 2023-02-14 11:02:35,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-14 11:02:35,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=edfe6fa82233a4c34cd9586ccba54c2e, ASSIGN in 343 msec 2023-02-14 11:02:35,368 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:35,368 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372555368"}]},"ts":"1676372555368"} 2023-02-14 11:02:35,369 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-14 11:02:35,373 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:35,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 382 msec 2023-02-14 11:02:35,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-14 11:02:35,393 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:35,393 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:35,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-14 11:02:35,403 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:35,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-14 11:02:35,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-14 11:02:35,415 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:35,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-14 11:02:35,421 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-14 11:02:35,424 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-14 11:02:35,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.986sec 2023-02-14 11:02:35,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-14 11:02:35,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-14 11:02:35,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-14 11:02:35,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46203,1676372554331-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-14 11:02:35,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46203,1676372554331-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-14 11:02:35,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-14 11:02:35,436 DEBUG [Listener at localhost/41179] zookeeper.ReadOnlyZKClient(139): Connect 0x63e03e3f to 127.0.0.1:64284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:35,439 DEBUG [Listener at localhost/41179] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a809726, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:35,440 DEBUG [hconnection-0x6eaf00d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:35,442 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52582, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:35,443 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:35,443 DEBUG [Listener at localhost/41179] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-14 11:02:35,446 DEBUG [Listener at localhost/41179] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-14 11:02:35,448 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39786, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-14 11:02:35,448 INFO [Listener at localhost/41179] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:35,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:35,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-14 11:02:35,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:39786 deadline: 1676372615448, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:35,449 INFO [Listener at localhost/41179] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-14 11:02:35,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:35,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:35,453 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:35,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-14 11:02:35,454 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:35,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:35,455 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,455 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064 empty. 2023-02-14 11:02:35,456 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,456 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-14 11:02:35,471 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:35,472 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 90ca5c6dfd382244a153654933f8d064, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp 2023-02-14 11:02:35,482 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:35,482 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 90ca5c6dfd382244a153654933f8d064, disabling compactions & flushes 2023-02-14 11:02:35,482 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:35,482 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:35,482 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. after waiting 0 ms 2023-02-14 11:02:35,482 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:35,482 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:35,482 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 90ca5c6dfd382244a153654933f8d064: 2023-02-14 11:02:35,484 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:35,485 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676372555485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372555485"}]},"ts":"1676372555485"} 2023-02-14 11:02:35,487 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:35,487 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:35,487 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372555487"}]},"ts":"1676372555487"} 2023-02-14 11:02:35,488 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-14 11:02:35,493 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:35,493 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:35,494 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:35,494 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:35,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=90ca5c6dfd382244a153654933f8d064, ASSIGN}] 2023-02-14 11:02:35,496 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=90ca5c6dfd382244a153654933f8d064, ASSIGN 2023-02-14 11:02:35,496 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=90ca5c6dfd382244a153654933f8d064, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45617,1676372554388; forceNewPlan=false, retain=false 2023-02-14 11:02:35,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:35,647 INFO [jenkins-hbase4:46203] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:35,647 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=90ca5c6dfd382244a153654933f8d064, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:35,647 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676372555647"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372555647"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372555647"}]},"ts":"1676372555647"} 2023-02-14 11:02:35,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 90ca5c6dfd382244a153654933f8d064, server=jenkins-hbase4.apache.org,45617,1676372554388}] 2023-02-14 11:02:35,654 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-14 11:02:35,723 INFO [RS:1;jenkins-hbase4:40521] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40521%2C1676372554413, suffix=, logDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/WALs/jenkins-hbase4.apache.org,40521,1676372554413, archiveDir=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/oldWALs, maxLogs=32 2023-02-14 11:02:35,746 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45447,DS-1f9a2642-14b0-491d-b064-1e03b26681c2,DISK] 2023-02-14 11:02:35,746 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40819,DS-599634c2-fba7-420e-86c8-ebb4f2fc191e,DISK] 2023-02-14 11:02:35,748 INFO [RS:1;jenkins-hbase4:40521] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/WALs/jenkins-hbase4.apache.org,40521,1676372554413/jenkins-hbase4.apache.org%2C40521%2C1676372554413.1676372555724 2023-02-14 11:02:35,749 DEBUG [RS:1;jenkins-hbase4:40521] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45447,DS-1f9a2642-14b0-491d-b064-1e03b26681c2,DISK], DatanodeInfoWithStorage[127.0.0.1:40819,DS-599634c2-fba7-420e-86c8-ebb4f2fc191e,DISK]] 2023-02-14 11:02:35,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:35,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:35,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 90ca5c6dfd382244a153654933f8d064, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:35,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:35,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,806 INFO [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,807 DEBUG [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1 2023-02-14 11:02:35,807 DEBUG [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1 2023-02-14 11:02:35,807 INFO [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90ca5c6dfd382244a153654933f8d064 columnFamilyName f1 2023-02-14 11:02:35,808 INFO [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] regionserver.HStore(310): Store=90ca5c6dfd382244a153654933f8d064/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:35,808 INFO [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,809 DEBUG [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2 2023-02-14 11:02:35,809 DEBUG [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2 2023-02-14 11:02:35,809 INFO [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90ca5c6dfd382244a153654933f8d064 columnFamilyName f2 2023-02-14 11:02:35,810 INFO [StoreOpener-90ca5c6dfd382244a153654933f8d064-1] regionserver.HStore(310): Store=90ca5c6dfd382244a153654933f8d064/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:35,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:35,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:35,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:35,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 90ca5c6dfd382244a153654933f8d064; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72614702, jitterRate=0.08204337954521179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:35,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 90ca5c6dfd382244a153654933f8d064: 2023-02-14 11:02:35,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064., pid=12, masterSystemTime=1676372555801 2023-02-14 11:02:35,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:35,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:35,818 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=90ca5c6dfd382244a153654933f8d064, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:35,818 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676372555818"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372555818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372555818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372555818"}]},"ts":"1676372555818"} 2023-02-14 11:02:35,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-14 11:02:35,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 90ca5c6dfd382244a153654933f8d064, server=jenkins-hbase4.apache.org,45617,1676372554388 in 170 msec 2023-02-14 11:02:35,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-14 11:02:35,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=90ca5c6dfd382244a153654933f8d064, ASSIGN in 327 msec 2023-02-14 11:02:35,823 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:35,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372555823"}]},"ts":"1676372555823"} 2023-02-14 11:02:35,824 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-14 11:02:35,826 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:35,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 375 msec 2023-02-14 11:02:36,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:36,058 INFO [Listener at localhost/41179] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-14 11:02:36,058 DEBUG [Listener at localhost/41179] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-14 11:02:36,059 INFO [Listener at localhost/41179] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:36,060 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-14 11:02:36,061 INFO [Listener at localhost/41179] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:36,061 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-14 11:02:36,061 INFO [Listener at localhost/41179] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-14 11:02:36,104 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45617] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,212 INFO [Listener at localhost/41179] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-14 11:02:36,212 INFO [Listener at localhost/41179] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-14 11:02:36,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-14 11:02:36,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676372556214 (current time:1676372556214). 2023-02-14 11:02:36,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-14 11:02:36,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] zookeeper.ReadOnlyZKClient(139): Connect 0x0694a967 to 127.0.0.1:64284 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:36,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28940f8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:36,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:36,220 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52592, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:36,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0694a967 to 127.0.0.1:64284 2023-02-14 11:02:36,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:36,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-14 11:02:36,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-14 11:02:36,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-14 11:02:36,225 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-14 11:02:36,225 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676373156225 2023-02-14 11:02:36,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-14 11:02:36,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,226 DEBUG [Listener at localhost/41179] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:36,227 DEBUG [Listener at localhost/41179] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-14 11:02:36,228 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-14 11:02:36,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-14 11:02:36,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-14 11:02:36,229 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-14 11:02:36,230 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676373156230 2023-02-14 11:02:36,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-14 11:02:36,238 INFO [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-14 11:02:36,238 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:36,238 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-14 11:02:36,238 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-14 11:02:36,239 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,239 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:36,242 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:36,242 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:36,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:36,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:36,242 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-14 11:02:36,243 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,243 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-14 11:02:36,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-14 11:02:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-14 11:02:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:36,243 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-14 11:02:36,244 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-14 11:02:36,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-14 11:02:36,244 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-14 11:02:36,244 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:36,245 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-14 11:02:36,245 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-14 11:02:36,245 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-14 11:02:36,245 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40521,1676372554413' joining acquired barrier for procedure (foo) in zk 2023-02-14 11:02:36,245 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-14 11:02:36,245 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:36,246 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-14 11:02:36,246 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-14 11:02:36,246 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45617,1676372554388' joining acquired barrier for procedure (foo) in zk 2023-02-14 11:02:36,247 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,248 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:36,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45617,1676372554388' joining acquired barrier for procedure 'foo' on coordinator 2023-02-14 11:02:36,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c83a163[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:36,250 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-14 11:02:36,250 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,251 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,251 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-14 11:02:36,251 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,251 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-14 11:02:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-14 11:02:36,252 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:02:36,252 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,252 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-14 11:02:36,252 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40521,1676372554413' in zk 2023-02-14 11:02:36,252 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. started... 2023-02-14 11:02:36,252 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 90ca5c6dfd382244a153654933f8d064 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-14 11:02:36,256 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-14 11:02:36,256 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:36,256 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-14 11:02:36,269 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/.tmp/f1/5cab9664ccb54ffab3dc5349e5e84b43 2023-02-14 11:02:36,288 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/.tmp/f2/843bc1fb8a5b430b933d9fa2b194cbe6 2023-02-14 11:02:36,292 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/.tmp/f1/5cab9664ccb54ffab3dc5349e5e84b43 as hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/5cab9664ccb54ffab3dc5349e5e84b43 2023-02-14 11:02:36,296 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/5cab9664ccb54ffab3dc5349e5e84b43, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-14 11:02:36,297 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/.tmp/f2/843bc1fb8a5b430b933d9fa2b194cbe6 as hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/843bc1fb8a5b430b933d9fa2b194cbe6 2023-02-14 11:02:36,301 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/843bc1fb8a5b430b933d9fa2b194cbe6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-14 11:02:36,302 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 90ca5c6dfd382244a153654933f8d064 in 50ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:36,302 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-14 11:02:36,303 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 90ca5c6dfd382244a153654933f8d064: 2023-02-14 11:02:36,303 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.' region-info for snapshot=foo 2023-02-14 11:02:36,303 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:36,303 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/5cab9664ccb54ffab3dc5349e5e84b43] hfiles 2023-02-14 11:02:36,303 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/5cab9664ccb54ffab3dc5349e5e84b43 for snapshot=foo 2023-02-14 11:02:36,303 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/843bc1fb8a5b430b933d9fa2b194cbe6] hfiles 2023-02-14 11:02:36,303 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/843bc1fb8a5b430b933d9fa2b194cbe6 for snapshot=foo 2023-02-14 11:02:36,328 DEBUG [Listener at localhost/41179] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:36,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-14 11:02:36,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:36,329 DEBUG [Listener at localhost/41179] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-14 11:02:36,330 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. completed. 2023-02-14 11:02:36,330 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,330 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-14 11:02:36,330 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-14 11:02:36,330 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,330 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-14 11:02:36,330 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45617,1676372554388' in zk 2023-02-14 11:02:36,332 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-14 11:02:36,332 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,332 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:36,332 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-14 11:02:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,45617,1676372554388': 2023-02-14 11:02:36,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45617,1676372554388' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-14 11:02:36,335 INFO [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-14 11:02:36,336 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:36,336 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:36,336 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-14 11:02:36,336 INFO [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-14 11:02:36,337 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,337 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,337 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,337 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:36,337 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:36,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:36,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:36,338 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:36,339 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:36,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,340 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,340 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:36,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-14 11:02:36,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:36,347 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:36,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:36,347 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:36,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-14 11:02:36,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:36,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:36,347 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:36,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:36,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.hbase-snapshot/.tmp/foo 2023-02-14 11:02:36,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:36,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:36,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:36,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:36,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.hbase-snapshot/.tmp/foo to hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.hbase-snapshot/foo 2023-02-14 11:02:36,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-14 11:02:36,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.hbase-snapshot/.tmp/foo 2023-02-14 11:02:36,392 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.hbase-snapshot/.tmp/foo 2023-02-14 11:02:36,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676372556226Consolidate snapshot: foo at 1676372556347 (+121 ms)Loading Region manifests for foo at 1676372556347Writing data manifest for foo at 1676372556350 (+3 ms)Verifying snapshot: foo at 1676372556357 (+7 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676372556391 (+34 ms) 2023-02-14 11:02:36,397 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-14 11:02:36,398 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 170 msec 2023-02-14 11:02:36,530 DEBUG [Listener at localhost/41179] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:36,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-14 11:02:36,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-14 11:02:36,531 INFO [Listener at localhost/41179] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-14 11:02:36,535 INFO [Listener at localhost/41179] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-14 11:02:36,540 INFO [Listener at localhost/41179] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-14 11:02:36,577 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45617] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,668 INFO [Listener at localhost/41179] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-14 11:02:36,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-14 11:02:36,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,676 INFO [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-14 11:02:36,676 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:36,677 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-14 11:02:36,677 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-14 11:02:36,677 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,677 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,679 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:36,679 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:36,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:36,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:36,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:36,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:36,679 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,679 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,679 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:36,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,681 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-14 11:02:36,681 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:36,681 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-14 11:02:36,682 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:36,682 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-14 11:02:36,682 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-14 11:02:36,682 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-14 11:02:36,682 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40521,1676372554413' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-14 11:02:36,683 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-14 11:02:36,683 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:36,683 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,683 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. started... 2023-02-14 11:02:36,683 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 90ca5c6dfd382244a153654933f8d064 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-14 11:02:36,684 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,687 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,687 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:36,701 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/.tmp/f1/d833692a235d4a889195cb35885088b9 2023-02-14 11:02:36,722 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/.tmp/f2/2573796316bb4e31828c6e76a043aab7 2023-02-14 11:02:36,726 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/.tmp/f1/d833692a235d4a889195cb35885088b9 as hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/d833692a235d4a889195cb35885088b9 2023-02-14 11:02:36,730 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/d833692a235d4a889195cb35885088b9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-14 11:02:36,731 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/.tmp/f2/2573796316bb4e31828c6e76a043aab7 as hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/2573796316bb4e31828c6e76a043aab7 2023-02-14 11:02:36,735 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/2573796316bb4e31828c6e76a043aab7, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-14 11:02:36,736 INFO [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 90ca5c6dfd382244a153654933f8d064 in 53ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:36,737 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 90ca5c6dfd382244a153654933f8d064: 2023-02-14 11:02:36,737 DEBUG [rs(jenkins-hbase4.apache.org,45617,1676372554388)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-14 11:02:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-14 11:02:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-14 11:02:36,738 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45617,1676372554388' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-14 11:02:36,739 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,739 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:36,740 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,740 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:36,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45617,1676372554388' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-14 11:02:36,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48bc2c2b[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:36,742 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-14 11:02:36,742 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,744 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,744 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,745 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,745 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-14 11:02:36,745 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-14 11:02:36,745 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,45617,1676372554388' in zk 2023-02-14 11:02:36,745 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-14 11:02:36,745 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-14 11:02:36,745 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,40521,1676372554413' in zk 2023-02-14 11:02:36,745 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:36,746 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-14 11:02:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,45617,1676372554388' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-14 11:02:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-14 11:02:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,40521,1676372554413' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-14 11:02:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,45617,1676372554388': 2023-02-14 11:02:36,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45617,1676372554388' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-14 11:02:36,750 INFO [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-14 11:02:36,750 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:36,750 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:36,750 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,750 INFO [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-14 11:02:36,752 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,752 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,752 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:36,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,752 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,752 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:36,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:36,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:36,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:36,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,753 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:36,753 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:36,755 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,755 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:36,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:36,759 DEBUG [(jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:36,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-14 11:02:36,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-14 11:02:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:36,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:36,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:36,760 DEBUG [Listener at localhost/41179] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-14 11:02:36,759 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,760 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,760 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:36,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:36,860 DEBUG [Listener at localhost/41179] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-14 11:02:36,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-14 11:02:36,865 INFO [Listener at localhost/41179] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676372556214 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:36,865 DEBUG [Listener at localhost/41179] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42869/user/jenkins/test-data/939015f2-a99c-8e4e-90b3-33a781b5ef20/foo/fed91716-ebeb-4b6f-8baf-c5aa7561d5f4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,865 INFO [Listener at localhost/41179] snapshot.RestoreSnapshotHelper(239): region to add: 90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:36,866 INFO [Listener at localhost/41179] snapshot.RestoreSnapshotHelper(585): clone region=90ca5c6dfd382244a153654933f8d064 as 90ca5c6dfd382244a153654933f8d064 in snapshot foo 2023-02-14 11:02:36,866 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 90ca5c6dfd382244a153654933f8d064, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42869/user/jenkins/test-data/939015f2-a99c-8e4e-90b3-33a781b5ef20/foo/fed91716-ebeb-4b6f-8baf-c5aa7561d5f4 2023-02-14 11:02:36,872 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:36,873 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5cab9664ccb54ffab3dc5349e5e84b43 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,874 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 843bc1fb8a5b430b933d9fa2b194cbe6 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,876 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 90ca5c6dfd382244a153654933f8d064, disabling compactions & flushes 2023-02-14 11:02:36,876 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. after waiting 0 ms 2023-02-14 11:02:36,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,877 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:36,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 90ca5c6dfd382244a153654933f8d064: 2023-02-14 11:02:36,879 INFO [Listener at localhost/41179] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676372556214 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:36,879 DEBUG [Listener at localhost/41179] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42869/user/jenkins/test-data/939015f2-a99c-8e4e-90b3-33a781b5ef20/foo/fed91716-ebeb-4b6f-8baf-c5aa7561d5f4 2023-02-14 11:02:36,879 DEBUG [Listener at localhost/41179] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42869/user/jenkins/test-data/939015f2-a99c-8e4e-90b3-33a781b5ef20/foo/fed91716-ebeb-4b6f-8baf-c5aa7561d5f4 2023-02-14 11:02:36,879 DEBUG [Listener at localhost/41179] util.CommonFSUtils(699): |-data/ 2023-02-14 11:02:36,880 DEBUG [Listener at localhost/41179] util.CommonFSUtils(699): |----default/ 2023-02-14 11:02:36,880 DEBUG [Listener at localhost/41179] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-14 11:02:36,880 DEBUG [Listener at localhost/41179] util.CommonFSUtils(699): |----------90ca5c6dfd382244a153654933f8d064/ 2023-02-14 11:02:36,881 DEBUG [Listener at localhost/41179] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:36,881 DEBUG [Listener at localhost/41179] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:36,881 DEBUG [Listener at localhost/41179] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=90ca5c6dfd382244a153654933f8d064-5cab9664ccb54ffab3dc5349e5e84b43 2023-02-14 11:02:36,881 DEBUG [Listener at localhost/41179] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:36,881 DEBUG [Listener at localhost/41179] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=90ca5c6dfd382244a153654933f8d064-843bc1fb8a5b430b933d9fa2b194cbe6 hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/5cab9664ccb54ffab3dc5349e5e84b43 hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/d833692a235d4a889195cb35885088b9 hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/2573796316bb4e31828c6e76a043aab7 hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/843bc1fb8a5b430b933d9fa2b194cbe6 2023-02-14 11:02:36,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-14 11:02:36,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-14 11:02:36,894 INFO [Listener at localhost/41179] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:36,900 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372556899"}]},"ts":"1676372556899"} 2023-02-14 11:02:36,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:36,901 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-14 11:02:36,903 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-14 11:02:36,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=90ca5c6dfd382244a153654933f8d064, UNASSIGN}] 2023-02-14 11:02:36,905 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=90ca5c6dfd382244a153654933f8d064, UNASSIGN 2023-02-14 11:02:36,905 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=90ca5c6dfd382244a153654933f8d064, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:36,906 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676372556905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372556905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372556905"}]},"ts":"1676372556905"} 2023-02-14 11:02:36,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 90ca5c6dfd382244a153654933f8d064, server=jenkins-hbase4.apache.org,45617,1676372554388}] 2023-02-14 11:02:37,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:37,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:37,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 90ca5c6dfd382244a153654933f8d064, disabling compactions & flushes 2023-02-14 11:02:37,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:37,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:37,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. after waiting 0 ms 2023-02-14 11:02:37,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:37,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:37,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064. 2023-02-14 11:02:37,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 90ca5c6dfd382244a153654933f8d064: 2023-02-14 11:02:37,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:37,065 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=90ca5c6dfd382244a153654933f8d064, regionState=CLOSED 2023-02-14 11:02:37,065 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676372557065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372557065"}]},"ts":"1676372557065"} 2023-02-14 11:02:37,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-14 11:02:37,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 90ca5c6dfd382244a153654933f8d064, server=jenkins-hbase4.apache.org,45617,1676372554388 in 159 msec 2023-02-14 11:02:37,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-14 11:02:37,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=90ca5c6dfd382244a153654933f8d064, UNASSIGN in 165 msec 2023-02-14 11:02:37,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372557070"}]},"ts":"1676372557070"} 2023-02-14 11:02:37,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-14 11:02:37,073 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-14 11:02:37,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 179 msec 2023-02-14 11:02:37,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:37,203 INFO [Listener at localhost/41179] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-14 11:02:37,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:37,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:37,207 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:37,208 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:37,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-14 11:02:37,211 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:37,214 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1, FileablePath, hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2, FileablePath, hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/recovered.edits] 2023-02-14 11:02:37,218 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/5cab9664ccb54ffab3dc5349e5e84b43 to hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/5cab9664ccb54ffab3dc5349e5e84b43 2023-02-14 11:02:37,220 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/d833692a235d4a889195cb35885088b9 to hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f1/d833692a235d4a889195cb35885088b9 2023-02-14 11:02:37,223 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/2573796316bb4e31828c6e76a043aab7 to hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/2573796316bb4e31828c6e76a043aab7 2023-02-14 11:02:37,224 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/843bc1fb8a5b430b933d9fa2b194cbe6 to hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/f2/843bc1fb8a5b430b933d9fa2b194cbe6 2023-02-14 11:02:37,227 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/recovered.edits/12.seqid to hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064/recovered.edits/12.seqid 2023-02-14 11:02:37,229 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/90ca5c6dfd382244a153654933f8d064 2023-02-14 11:02:37,229 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-14 11:02:37,234 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:37,236 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-14 11:02:37,237 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-14 11:02:37,238 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:37,238 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-14 11:02:37,238 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372557238"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:37,239 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-14 11:02:37,240 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 90ca5c6dfd382244a153654933f8d064, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676372555451.90ca5c6dfd382244a153654933f8d064.', STARTKEY => '', ENDKEY => ''}] 2023-02-14 11:02:37,240 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-14 11:02:37,240 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676372557240"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:37,241 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-14 11:02:37,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-14 11:02:37,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 40 msec 2023-02-14 11:02:37,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46203] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-14 11:02:37,310 INFO [Listener at localhost/41179] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-14 11:02:37,310 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-14 11:02:37,310 INFO [Listener at localhost/41179] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-14 11:02:37,310 DEBUG [Listener at localhost/41179] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63e03e3f to 127.0.0.1:64284 2023-02-14 11:02:37,310 DEBUG [Listener at localhost/41179] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:37,310 DEBUG [Listener at localhost/41179] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-14 11:02:37,310 DEBUG [Listener at localhost/41179] util.JVMClusterUtil(257): Found active master hash=2098943174, stopped=false 2023-02-14 11:02:37,311 INFO [Listener at localhost/41179] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:37,314 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:37,314 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:37,314 INFO [Listener at localhost/41179] procedure2.ProcedureExecutor(629): Stopping 2023-02-14 11:02:37,314 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:37,314 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:37,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:37,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:37,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:37,315 DEBUG [Listener at localhost/41179] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d01bccb to 127.0.0.1:64284 2023-02-14 11:02:37,315 DEBUG [Listener at localhost/41179] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:37,315 INFO [Listener at localhost/41179] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45617,1676372554388' ***** 2023-02-14 11:02:37,315 INFO [Listener at localhost/41179] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:37,315 INFO [Listener at localhost/41179] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40521,1676372554413' ***** 2023-02-14 11:02:37,315 INFO [Listener at localhost/41179] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:37,315 INFO [RS:1;jenkins-hbase4:40521] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:37,315 INFO [RS:1;jenkins-hbase4:40521] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:37,315 INFO [RS:0;jenkins-hbase4:45617] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:37,315 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:37,315 INFO [RS:0;jenkins-hbase4:45617] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:37,315 INFO [RS:1;jenkins-hbase4:40521] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:37,316 INFO [RS:0;jenkins-hbase4:45617] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:37,316 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(3304): Received CLOSE for edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:37,316 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:37,316 DEBUG [RS:0;jenkins-hbase4:45617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11671a7c to 127.0.0.1:64284 2023-02-14 11:02:37,315 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:37,317 DEBUG [RS:0;jenkins-hbase4:45617] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:37,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing edfe6fa82233a4c34cd9586ccba54c2e, disabling compactions & flushes 2023-02-14 11:02:37,316 INFO [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:37,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:37,318 DEBUG [RS:1;jenkins-hbase4:40521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ddaf089 to 127.0.0.1:64284 2023-02-14 11:02:37,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:37,318 INFO [RS:0;jenkins-hbase4:45617] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:37,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. after waiting 0 ms 2023-02-14 11:02:37,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:37,318 DEBUG [RS:1;jenkins-hbase4:40521] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:37,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing edfe6fa82233a4c34cd9586ccba54c2e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-14 11:02:37,318 INFO [RS:0;jenkins-hbase4:45617] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:37,318 INFO [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40521,1676372554413; all regions closed. 2023-02-14 11:02:37,318 INFO [RS:0;jenkins-hbase4:45617] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:37,318 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-14 11:02:37,318 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-14 11:02:37,318 DEBUG [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, edfe6fa82233a4c34cd9586ccba54c2e=hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e.} 2023-02-14 11:02:37,318 DEBUG [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1505): Waiting on 1588230740, edfe6fa82233a4c34cd9586ccba54c2e 2023-02-14 11:02:37,319 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:37,319 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:37,319 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:37,319 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:37,319 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:37,319 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-14 11:02:37,321 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/WALs/jenkins-hbase4.apache.org,40521,1676372554413/jenkins-hbase4.apache.org%2C40521%2C1676372554413.1676372555724 not finished, retry = 0 2023-02-14 11:02:37,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/.tmp/info/1d416259678a4809b559ce41bb609110 2023-02-14 11:02:37,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e/.tmp/info/33a604e2effb4e988ca893ec54fa9499 2023-02-14 11:02:37,342 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d416259678a4809b559ce41bb609110 2023-02-14 11:02:37,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e/.tmp/info/33a604e2effb4e988ca893ec54fa9499 as hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e/info/33a604e2effb4e988ca893ec54fa9499 2023-02-14 11:02:37,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e/info/33a604e2effb4e988ca893ec54fa9499, entries=2, sequenceid=6, filesize=4.8 K 2023-02-14 11:02:37,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for edfe6fa82233a4c34cd9586ccba54c2e in 30ms, sequenceid=6, compaction requested=false 2023-02-14 11:02:37,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/.tmp/rep_barrier/93e99d1a970b41a2933e61d838be4d19 2023-02-14 11:02:37,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/namespace/edfe6fa82233a4c34cd9586ccba54c2e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-14 11:02:37,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:37,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for edfe6fa82233a4c34cd9586ccba54c2e: 2023-02-14 11:02:37,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676372554991.edfe6fa82233a4c34cd9586ccba54c2e. 2023-02-14 11:02:37,357 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93e99d1a970b41a2933e61d838be4d19 2023-02-14 11:02:37,368 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/.tmp/table/5a0c1afef015495aa503c4c0e4bdf6e0 2023-02-14 11:02:37,371 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a0c1afef015495aa503c4c0e4bdf6e0 2023-02-14 11:02:37,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/.tmp/info/1d416259678a4809b559ce41bb609110 as hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/info/1d416259678a4809b559ce41bb609110 2023-02-14 11:02:37,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d416259678a4809b559ce41bb609110 2023-02-14 11:02:37,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/info/1d416259678a4809b559ce41bb609110, entries=12, sequenceid=21, filesize=6.3 K 2023-02-14 11:02:37,376 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/.tmp/rep_barrier/93e99d1a970b41a2933e61d838be4d19 as hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/rep_barrier/93e99d1a970b41a2933e61d838be4d19 2023-02-14 11:02:37,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93e99d1a970b41a2933e61d838be4d19 2023-02-14 11:02:37,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/rep_barrier/93e99d1a970b41a2933e61d838be4d19, entries=1, sequenceid=21, filesize=5.1 K 2023-02-14 11:02:37,381 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/.tmp/table/5a0c1afef015495aa503c4c0e4bdf6e0 as hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/table/5a0c1afef015495aa503c4c0e4bdf6e0 2023-02-14 11:02:37,386 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a0c1afef015495aa503c4c0e4bdf6e0 2023-02-14 11:02:37,386 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/table/5a0c1afef015495aa503c4c0e4bdf6e0, entries=4, sequenceid=21, filesize=5.1 K 2023-02-14 11:02:37,386 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 67ms, sequenceid=21, compaction requested=false 2023-02-14 11:02:37,388 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:37,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-14 11:02:37,392 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:37,393 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:37,393 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:37,393 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:37,399 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:37,424 DEBUG [RS:1;jenkins-hbase4:40521] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/oldWALs 2023-02-14 11:02:37,424 INFO [RS:1;jenkins-hbase4:40521] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40521%2C1676372554413:(num 1676372555724) 2023-02-14 11:02:37,424 DEBUG [RS:1;jenkins-hbase4:40521] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:37,424 INFO [RS:1;jenkins-hbase4:40521] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:37,424 INFO [RS:1;jenkins-hbase4:40521] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:37,424 INFO [RS:1;jenkins-hbase4:40521] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:37,424 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:37,424 INFO [RS:1;jenkins-hbase4:40521] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:37,425 INFO [RS:1;jenkins-hbase4:40521] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:37,425 INFO [RS:1;jenkins-hbase4:40521] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40521 2023-02-14 11:02:37,429 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:37,429 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:37,429 ERROR [Listener at localhost/41179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6006fa50 rejected from java.util.concurrent.ThreadPoolExecutor@64396288[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:37,430 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:37,430 ERROR [Listener at localhost/41179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47d3a37d rejected from java.util.concurrent.ThreadPoolExecutor@64396288[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:37,429 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40521,1676372554413 2023-02-14 11:02:37,430 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:37,431 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40521,1676372554413] 2023-02-14 11:02:37,431 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40521,1676372554413; numProcessing=1 2023-02-14 11:02:37,432 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40521,1676372554413 already deleted, retry=false 2023-02-14 11:02:37,432 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40521,1676372554413 expired; onlineServers=1 2023-02-14 11:02:37,519 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45617,1676372554388; all regions closed. 2023-02-14 11:02:37,523 DEBUG [RS:0;jenkins-hbase4:45617] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/oldWALs 2023-02-14 11:02:37,523 INFO [RS:0;jenkins-hbase4:45617] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45617%2C1676372554388.meta:.meta(num 1676372554944) 2023-02-14 11:02:37,530 DEBUG [RS:0;jenkins-hbase4:45617] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/oldWALs 2023-02-14 11:02:37,530 INFO [RS:0;jenkins-hbase4:45617] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45617%2C1676372554388:(num 1676372555336) 2023-02-14 11:02:37,530 DEBUG [RS:0;jenkins-hbase4:45617] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:37,530 INFO [RS:0;jenkins-hbase4:45617] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:37,530 INFO [RS:0;jenkins-hbase4:45617] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:37,531 INFO [RS:0;jenkins-hbase4:45617] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45617 2023-02-14 11:02:37,531 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:37,533 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45617,1676372554388 2023-02-14 11:02:37,533 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:37,533 ERROR [Listener at localhost/41179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@312c4d1f rejected from java.util.concurrent.ThreadPoolExecutor@3513dfe2[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:37,535 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45617,1676372554388] 2023-02-14 11:02:37,535 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45617,1676372554388; numProcessing=2 2023-02-14 11:02:37,536 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45617,1676372554388 already deleted, retry=false 2023-02-14 11:02:37,536 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45617,1676372554388 expired; onlineServers=0 2023-02-14 11:02:37,536 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46203,1676372554331' ***** 2023-02-14 11:02:37,536 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-14 11:02:37,537 DEBUG [M:0;jenkins-hbase4:46203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7924cfbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:37,537 INFO [M:0;jenkins-hbase4:46203] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46203,1676372554331 2023-02-14 11:02:37,537 INFO [M:0;jenkins-hbase4:46203] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46203,1676372554331; all regions closed. 2023-02-14 11:02:37,537 DEBUG [M:0;jenkins-hbase4:46203] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:37,537 DEBUG [M:0;jenkins-hbase4:46203] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-14 11:02:37,537 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-14 11:02:37,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372554591] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372554591,5,FailOnTimeoutGroup] 2023-02-14 11:02:37,537 DEBUG [M:0;jenkins-hbase4:46203] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-14 11:02:37,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372554592] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372554592,5,FailOnTimeoutGroup] 2023-02-14 11:02:37,538 INFO [M:0;jenkins-hbase4:46203] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-14 11:02:37,538 INFO [M:0;jenkins-hbase4:46203] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-14 11:02:37,538 INFO [M:0;jenkins-hbase4:46203] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-14 11:02:37,538 DEBUG [M:0;jenkins-hbase4:46203] master.HMaster(1512): Stopping service threads 2023-02-14 11:02:37,539 INFO [M:0;jenkins-hbase4:46203] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-14 11:02:37,539 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:37,539 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:37,539 ERROR [M:0;jenkins-hbase4:46203] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-14 11:02:37,539 INFO [M:0;jenkins-hbase4:46203] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-14 11:02:37,539 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-14 11:02:37,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:37,540 DEBUG [M:0;jenkins-hbase4:46203] zookeeper.ZKUtil(398): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-14 11:02:37,540 WARN [M:0;jenkins-hbase4:46203] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-14 11:02:37,540 INFO [M:0;jenkins-hbase4:46203] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-14 11:02:37,540 INFO [M:0;jenkins-hbase4:46203] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-14 11:02:37,541 DEBUG [M:0;jenkins-hbase4:46203] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:37,541 INFO [M:0;jenkins-hbase4:46203] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:37,541 DEBUG [M:0;jenkins-hbase4:46203] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:37,541 DEBUG [M:0;jenkins-hbase4:46203] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:37,541 DEBUG [M:0;jenkins-hbase4:46203] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:37,541 INFO [M:0;jenkins-hbase4:46203] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.68 KB heapSize=67.66 KB 2023-02-14 11:02:37,553 INFO [M:0;jenkins-hbase4:46203] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d97e93fedc924a418dccd2bda2f7569b 2023-02-14 11:02:37,557 DEBUG [M:0;jenkins-hbase4:46203] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d97e93fedc924a418dccd2bda2f7569b as hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d97e93fedc924a418dccd2bda2f7569b 2023-02-14 11:02:37,562 INFO [M:0;jenkins-hbase4:46203] regionserver.HStore(1080): Added hdfs://localhost:42869/user/jenkins/test-data/940e4b4a-c136-c3d1-7b18-8fb3f78c5042/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d97e93fedc924a418dccd2bda2f7569b, entries=17, sequenceid=132, filesize=8.7 K 2023-02-14 11:02:37,562 INFO [M:0;jenkins-hbase4:46203] regionserver.HRegion(2947): Finished flush of dataSize ~56.68 KB/58040, heapSize ~67.64 KB/69264, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false 2023-02-14 11:02:37,563 INFO [M:0;jenkins-hbase4:46203] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:37,563 DEBUG [M:0;jenkins-hbase4:46203] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:37,565 INFO [M:0;jenkins-hbase4:46203] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-14 11:02:37,565 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:37,566 INFO [M:0;jenkins-hbase4:46203] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46203 2023-02-14 11:02:37,567 DEBUG [M:0;jenkins-hbase4:46203] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46203,1676372554331 already deleted, retry=false 2023-02-14 11:02:37,712 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:37,712 INFO [M:0;jenkins-hbase4:46203] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46203,1676372554331; zookeeper connection closed. 2023-02-14 11:02:37,713 ERROR [Listener at localhost/41179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@16c8d7aa rejected from java.util.concurrent.ThreadPoolExecutor@12f741ab[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:37,714 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): master:46203-0x100527f1c0a0000, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:37,714 ERROR [Listener at localhost/41179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36cd6c46 rejected from java.util.concurrent.ThreadPoolExecutor@12f741ab[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:37,813 INFO [RS:0;jenkins-hbase4:45617] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45617,1676372554388; zookeeper connection closed. 2023-02-14 11:02:37,813 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2ffa0ba8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2ffa0ba8 2023-02-14 11:02:37,813 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:37,813 ERROR [Listener at localhost/41179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@123c3290 rejected from java.util.concurrent.ThreadPoolExecutor@3513dfe2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:37,813 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:45617-0x100527f1c0a0001, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:37,814 ERROR [Listener at localhost/41179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a6cfa65 rejected from java.util.concurrent.ThreadPoolExecutor@3513dfe2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:37,913 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:37,913 INFO [RS:1;jenkins-hbase4:40521] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40521,1676372554413; zookeeper connection closed. 2023-02-14 11:02:37,913 ERROR [Listener at localhost/41179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3fd2181d rejected from java.util.concurrent.ThreadPoolExecutor@64396288[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:37,913 DEBUG [Listener at localhost/41179-EventThread] zookeeper.ZKWatcher(600): regionserver:40521-0x100527f1c0a0002, quorum=127.0.0.1:64284, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:37,913 ERROR [Listener at localhost/41179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b868430 rejected from java.util.concurrent.ThreadPoolExecutor@64396288[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:37,913 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@193126f3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@193126f3 2023-02-14 11:02:37,914 INFO [Listener at localhost/41179] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-14 11:02:37,914 WARN [Listener at localhost/41179] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:37,918 INFO [Listener at localhost/41179] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:37,923 WARN [BP-1093448852-172.31.14.131-1676372553741 heartbeating to localhost/127.0.0.1:42869] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:37,923 WARN [BP-1093448852-172.31.14.131-1676372553741 heartbeating to localhost/127.0.0.1:42869] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1093448852-172.31.14.131-1676372553741 (Datanode Uuid c378ab06-ef27-49e9-acda-ae6a2c2464a4) service to localhost/127.0.0.1:42869 2023-02-14 11:02:37,923 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/cluster_58b5c76c-031a-1e78-4470-e4bf549615ce/dfs/data/data3/current/BP-1093448852-172.31.14.131-1676372553741] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:37,924 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/cluster_58b5c76c-031a-1e78-4470-e4bf549615ce/dfs/data/data4/current/BP-1093448852-172.31.14.131-1676372553741] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:37,925 WARN [Listener at localhost/41179] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:37,950 INFO [Listener at localhost/41179] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:38,054 WARN [BP-1093448852-172.31.14.131-1676372553741 heartbeating to localhost/127.0.0.1:42869] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:38,054 WARN [BP-1093448852-172.31.14.131-1676372553741 heartbeating to localhost/127.0.0.1:42869] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1093448852-172.31.14.131-1676372553741 (Datanode Uuid 18107fbb-bd49-4853-bac3-34feb9a5d3ed) service to localhost/127.0.0.1:42869 2023-02-14 11:02:38,055 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/cluster_58b5c76c-031a-1e78-4470-e4bf549615ce/dfs/data/data1/current/BP-1093448852-172.31.14.131-1676372553741] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:38,055 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/cluster_58b5c76c-031a-1e78-4470-e4bf549615ce/dfs/data/data2/current/BP-1093448852-172.31.14.131-1676372553741] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:38,066 INFO [Listener at localhost/41179] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:38,178 INFO [Listener at localhost/41179] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-14 11:02:38,192 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-14 11:02:38,206 INFO [Listener at localhost/41179] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=275 (was 254) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41179 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:42869 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:42869 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:42869 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42869 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:42869 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:42869 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:42869 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46203,1676372554331)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=565 (was 652), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=256 (was 270), ProcessCount=168 (was 168), AvailableMemoryMB=5561 (was 5595) 2023-02-14 11:02:38,216 INFO [Listener at localhost/41179] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=275, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=168, AvailableMemoryMB=5561 2023-02-14 11:02:38,226 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/hadoop.log.dir so I do NOT create it in target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92 2023-02-14 11:02:38,226 WARN [Listener at localhost/41179] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/hadoop.log.dir Erasing configuration value by system value. 2023-02-14 11:02:38,226 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/hadoop.tmp.dir so I do NOT create it in target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92 2023-02-14 11:02:38,226 WARN [Listener at localhost/41179] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/985c7482-d1e1-3fcc-2aac-df7811ecce7b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-14 11:02:38,227 DEBUG [Listener at localhost/41179] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92 2023-02-14 11:02:38,227 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-14 11:02:38,227 INFO [Listener at localhost/41179] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/cluster_a2d6ce3e-9d73-edfb-92fb-e637f68f7292, deleteOnExit=true 2023-02-14 11:02:38,227 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-14 11:02:38,227 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/test.cache.data in system properties and HBase conf 2023-02-14 11:02:38,227 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/hadoop.tmp.dir in system properties and HBase conf 2023-02-14 11:02:38,227 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/hadoop.log.dir in system properties and HBase conf 2023-02-14 11:02:38,227 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-14 11:02:38,227 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-14 11:02:38,227 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-14 11:02:38,228 DEBUG [Listener at localhost/41179] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-14 11:02:38,228 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:38,228 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-14 11:02:38,228 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-14 11:02:38,228 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:38,228 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-14 11:02:38,228 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-14 11:02:38,228 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-14 11:02:38,228 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:38,228 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-14 11:02:38,229 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/nfs.dump.dir in system properties and HBase conf 2023-02-14 11:02:38,229 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/java.io.tmpdir in system properties and HBase conf 2023-02-14 11:02:38,229 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-14 11:02:38,229 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-14 11:02:38,229 INFO [Listener at localhost/41179] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-14 11:02:38,233 WARN [Listener at localhost/41179] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:38,233 WARN [Listener at localhost/41179] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:38,272 WARN [Listener at localhost/41179] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:38,274 INFO [Listener at localhost/41179] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:38,279 INFO [Listener at localhost/41179] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/java.io.tmpdir/Jetty_localhost_36893_hdfs____.abzjnr/webapp 2023-02-14 11:02:38,372 INFO [Listener at localhost/41179] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36893 2023-02-14 11:02:38,377 WARN [Listener at localhost/41179] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-14 11:02:38,377 WARN [Listener at localhost/41179] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-14 11:02:38,420 WARN [Listener at localhost/41671] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:38,434 WARN [Listener at localhost/41671] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:38,436 WARN [Listener at localhost/41671] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:38,437 INFO [Listener at localhost/41671] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:38,446 INFO [Listener at localhost/41671] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/java.io.tmpdir/Jetty_localhost_44763_datanode____i4y3rv/webapp 2023-02-14 11:02:38,544 INFO [Listener at localhost/41671] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44763 2023-02-14 11:02:38,551 WARN [Listener at localhost/33285] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:38,575 WARN [Listener at localhost/33285] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-14 11:02:38,577 WARN [Listener at localhost/33285] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-14 11:02:38,578 INFO [Listener at localhost/33285] log.Slf4jLog(67): jetty-6.1.26 2023-02-14 11:02:38,581 INFO [Listener at localhost/33285] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/java.io.tmpdir/Jetty_localhost_41691_datanode____35n994/webapp 2023-02-14 11:02:38,664 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x58dce0cefea2e4e: Processing first storage report for DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae from datanode d3a8ba9d-7ed6-4414-9602-97f91f2371bd 2023-02-14 11:02:38,664 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x58dce0cefea2e4e: from storage DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae node DatanodeRegistration(127.0.0.1:46779, datanodeUuid=d3a8ba9d-7ed6-4414-9602-97f91f2371bd, infoPort=37615, infoSecurePort=0, ipcPort=33285, storageInfo=lv=-57;cid=testClusterID;nsid=309849563;c=1676372558235), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:38,664 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x58dce0cefea2e4e: Processing first storage report for DS-c0ff01dc-0c4b-47d2-ac94-28e4e595f3af from datanode d3a8ba9d-7ed6-4414-9602-97f91f2371bd 2023-02-14 11:02:38,664 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x58dce0cefea2e4e: from storage DS-c0ff01dc-0c4b-47d2-ac94-28e4e595f3af node DatanodeRegistration(127.0.0.1:46779, datanodeUuid=d3a8ba9d-7ed6-4414-9602-97f91f2371bd, infoPort=37615, infoSecurePort=0, ipcPort=33285, storageInfo=lv=-57;cid=testClusterID;nsid=309849563;c=1676372558235), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:38,681 INFO [Listener at localhost/33285] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41691 2023-02-14 11:02:38,689 WARN [Listener at localhost/43505] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-14 11:02:38,778 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x34fff144149e9029: Processing first storage report for DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada from datanode 2dc95637-91ab-42ee-902a-d37ff375e5c5 2023-02-14 11:02:38,778 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x34fff144149e9029: from storage DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada node DatanodeRegistration(127.0.0.1:38785, datanodeUuid=2dc95637-91ab-42ee-902a-d37ff375e5c5, infoPort=44147, infoSecurePort=0, ipcPort=43505, storageInfo=lv=-57;cid=testClusterID;nsid=309849563;c=1676372558235), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:38,778 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x34fff144149e9029: Processing first storage report for DS-ac7e123f-0b32-4b87-ab59-40108c80314d from datanode 2dc95637-91ab-42ee-902a-d37ff375e5c5 2023-02-14 11:02:38,778 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x34fff144149e9029: from storage DS-ac7e123f-0b32-4b87-ab59-40108c80314d node DatanodeRegistration(127.0.0.1:38785, datanodeUuid=2dc95637-91ab-42ee-902a-d37ff375e5c5, infoPort=44147, infoSecurePort=0, ipcPort=43505, storageInfo=lv=-57;cid=testClusterID;nsid=309849563;c=1676372558235), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-14 11:02:38,795 DEBUG [Listener at localhost/43505] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92 2023-02-14 11:02:38,797 INFO [Listener at localhost/43505] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/cluster_a2d6ce3e-9d73-edfb-92fb-e637f68f7292/zookeeper_0, clientPort=49570, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/cluster_a2d6ce3e-9d73-edfb-92fb-e637f68f7292/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/cluster_a2d6ce3e-9d73-edfb-92fb-e637f68f7292/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-14 11:02:38,798 INFO [Listener at localhost/43505] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49570 2023-02-14 11:02:38,798 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,799 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,809 INFO [Listener at localhost/43505] util.FSUtils(479): Created version file at hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b with version=8 2023-02-14 11:02:38,810 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,810 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,811 INFO [Listener at localhost/43505] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41671/user/jenkins/test-data/91e5a7cd-d6c2-f6ec-0298-b20a2182f9b2/hbase-staging 2023-02-14 11:02:38,813 INFO [Listener at localhost/43505] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:38,813 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:38,813 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:38,813 INFO [Listener at localhost/43505] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:38,813 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:38,813 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:38,813 INFO [Listener at localhost/43505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:38,814 INFO [Listener at localhost/43505] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40235 2023-02-14 11:02:38,814 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,815 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,816 INFO [Listener at localhost/43505] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40235 connecting to ZooKeeper ensemble=127.0.0.1:49570 2023-02-14 11:02:38,821 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:402350x0, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:38,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40235-0x100527f2d920000 connected 2023-02-14 11:02:38,836 DEBUG [Listener at localhost/43505] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:38,837 DEBUG [Listener at localhost/43505] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:38,837 DEBUG [Listener at localhost/43505] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:38,840 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40235 2023-02-14 11:02:38,840 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40235 2023-02-14 11:02:38,840 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40235 2023-02-14 11:02:38,844 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40235 2023-02-14 11:02:38,844 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40235 2023-02-14 11:02:38,844 INFO [Listener at localhost/43505] master.HMaster(444): hbase.rootdir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b, hbase.cluster.distributed=false 2023-02-14 11:02:38,857 INFO [Listener at localhost/43505] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:38,857 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:38,857 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:38,857 INFO [Listener at localhost/43505] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:38,857 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:38,857 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:38,857 INFO [Listener at localhost/43505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:38,859 INFO [Listener at localhost/43505] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41535 2023-02-14 11:02:38,859 INFO [Listener at localhost/43505] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:38,860 DEBUG [Listener at localhost/43505] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:38,861 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,861 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,862 INFO [Listener at localhost/43505] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41535 connecting to ZooKeeper ensemble=127.0.0.1:49570 2023-02-14 11:02:38,865 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:415350x0, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:38,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41535-0x100527f2d920001 connected 2023-02-14 11:02:38,868 DEBUG [Listener at localhost/43505] zookeeper.ZKUtil(164): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:38,869 DEBUG [Listener at localhost/43505] zookeeper.ZKUtil(164): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:38,869 DEBUG [Listener at localhost/43505] zookeeper.ZKUtil(164): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:38,870 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41535 2023-02-14 11:02:38,871 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41535 2023-02-14 11:02:38,872 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41535 2023-02-14 11:02:38,874 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41535 2023-02-14 11:02:38,876 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41535 2023-02-14 11:02:38,886 INFO [Listener at localhost/43505] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-14 11:02:38,886 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:38,886 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:38,886 INFO [Listener at localhost/43505] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-14 11:02:38,887 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-14 11:02:38,887 INFO [Listener at localhost/43505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-14 11:02:38,887 INFO [Listener at localhost/43505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-14 11:02:38,887 INFO [Listener at localhost/43505] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38173 2023-02-14 11:02:38,887 INFO [Listener at localhost/43505] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-14 11:02:38,888 DEBUG [Listener at localhost/43505] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:38,888 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,889 INFO [Listener at localhost/43505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,890 INFO [Listener at localhost/43505] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38173 connecting to ZooKeeper ensemble=127.0.0.1:49570 2023-02-14 11:02:38,894 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:381730x0, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-14 11:02:38,894 DEBUG [Listener at localhost/43505] zookeeper.ZKUtil(164): regionserver:381730x0, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:38,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38173-0x100527f2d920002 connected 2023-02-14 11:02:38,895 DEBUG [Listener at localhost/43505] zookeeper.ZKUtil(164): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:38,895 DEBUG [Listener at localhost/43505] zookeeper.ZKUtil(164): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-14 11:02:38,900 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38173 2023-02-14 11:02:38,900 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38173 2023-02-14 11:02:38,900 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38173 2023-02-14 11:02:38,901 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38173 2023-02-14 11:02:38,901 DEBUG [Listener at localhost/43505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38173 2023-02-14 11:02:38,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:38,903 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:38,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:38,905 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:38,905 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:38,905 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:38,907 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:38,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:38,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40235,1676372558813 from backup master directory 2023-02-14 11:02:38,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-14 11:02:38,910 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:38,910 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-14 11:02:38,910 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:38,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:38,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/hbase.id with ID: fa76e104-e327-469d-97c1-f80f9e67092e 2023-02-14 11:02:38,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-14 11:02:38,932 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:38,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0ccde700 to 127.0.0.1:49570 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:38,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c063cfc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:38,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:38,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-14 11:02:38,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:38,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/data/master/store-tmp 2023-02-14 11:02:38,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:38,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:38,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:38,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:38,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:38,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:38,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:38,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:38,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/WALs/jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:38,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40235%2C1676372558813, suffix=, logDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/WALs/jenkins-hbase4.apache.org,40235,1676372558813, archiveDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/oldWALs, maxLogs=10 2023-02-14 11:02:38,980 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46779,DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae,DISK] 2023-02-14 11:02:38,980 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38785,DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada,DISK] 2023-02-14 11:02:38,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/WALs/jenkins-hbase4.apache.org,40235,1676372558813/jenkins-hbase4.apache.org%2C40235%2C1676372558813.1676372558967 2023-02-14 11:02:38,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46779,DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae,DISK], DatanodeInfoWithStorage[127.0.0.1:38785,DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada,DISK]] 2023-02-14 11:02:38,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:38,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:38,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:38,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:38,984 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:38,985 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-14 11:02:38,985 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-14 11:02:38,987 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:38,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:38,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:38,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-14 11:02:38,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:38,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66065156, jitterRate=-0.01555246114730835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:38,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:38,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-14 11:02:38,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-14 11:02:38,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-14 11:02:38,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-14 11:02:38,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-14 11:02:38,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-14 11:02:38,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-14 11:02:39,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-14 11:02:39,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-14 11:02:39,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-14 11:02:39,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-14 11:02:39,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-14 11:02:39,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-14 11:02:39,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-14 11:02:39,013 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:39,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-14 11:02:39,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-14 11:02:39,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-14 11:02:39,016 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:39,016 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:39,016 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:39,016 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:39,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40235,1676372558813, sessionid=0x100527f2d920000, setting cluster-up flag (Was=false) 2023-02-14 11:02:39,026 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:39,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-14 11:02:39,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:39,033 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:39,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-14 11:02:39,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:39,038 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.hbase-snapshot/.tmp 2023-02-14 11:02:39,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:39,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:39,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:39,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:39,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-14 11:02:39,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-14 11:02:39,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:39,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676372589050 2023-02-14 11:02:39,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-14 11:02:39,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-14 11:02:39,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-14 11:02:39,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-14 11:02:39,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-14 11:02:39,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-14 11:02:39,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-14 11:02:39,051 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:39,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-14 11:02:39,051 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-14 11:02:39,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-14 11:02:39,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-14 11:02:39,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-14 11:02:39,052 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:39,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372559052,5,FailOnTimeoutGroup] 2023-02-14 11:02:39,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372559053,5,FailOnTimeoutGroup] 2023-02-14 11:02:39,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-14 11:02:39,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,064 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:39,065 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:39,065 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b 2023-02-14 11:02:39,072 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:39,073 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:39,074 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/info 2023-02-14 11:02:39,075 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:39,075 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:39,075 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:39,076 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:39,076 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:39,076 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:39,077 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:39,077 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/table 2023-02-14 11:02:39,078 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:39,078 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:39,078 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740 2023-02-14 11:02:39,079 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740 2023-02-14 11:02:39,080 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:39,081 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:39,084 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:39,085 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59277742, jitterRate=-0.11669281125068665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:39,085 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:39,085 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:39,085 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:39,085 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:39,085 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:39,085 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:39,085 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:39,085 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:39,086 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-14 11:02:39,086 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-14 11:02:39,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-14 11:02:39,087 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-14 11:02:39,089 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-14 11:02:39,103 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(952): ClusterId : fa76e104-e327-469d-97c1-f80f9e67092e 2023-02-14 11:02:39,103 INFO [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(952): ClusterId : fa76e104-e327-469d-97c1-f80f9e67092e 2023-02-14 11:02:39,103 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:39,103 DEBUG [RS:1;jenkins-hbase4:38173] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-14 11:02:39,104 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:39,105 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:39,105 DEBUG [RS:1;jenkins-hbase4:38173] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-14 11:02:39,105 DEBUG [RS:1;jenkins-hbase4:38173] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-14 11:02:39,107 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:39,108 DEBUG [RS:0;jenkins-hbase4:41535] zookeeper.ReadOnlyZKClient(139): Connect 0x4f1df2e1 to 127.0.0.1:49570 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:39,108 DEBUG [RS:1;jenkins-hbase4:38173] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-14 11:02:39,109 DEBUG [RS:1;jenkins-hbase4:38173] zookeeper.ReadOnlyZKClient(139): Connect 0x7a47cfff to 127.0.0.1:49570 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:39,112 DEBUG [RS:0;jenkins-hbase4:41535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41da0572, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:39,112 DEBUG [RS:0;jenkins-hbase4:41535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45e59991, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:39,114 DEBUG [RS:1;jenkins-hbase4:38173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74802ec7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:39,114 DEBUG [RS:1;jenkins-hbase4:38173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70bfa48f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:39,121 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41535 2023-02-14 11:02:39,121 INFO [RS:0;jenkins-hbase4:41535] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:39,121 INFO [RS:0;jenkins-hbase4:41535] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:39,121 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:39,122 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40235,1676372558813 with isa=jenkins-hbase4.apache.org/172.31.14.131:41535, startcode=1676372558856 2023-02-14 11:02:39,122 DEBUG [RS:0;jenkins-hbase4:41535] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:39,124 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49605, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:39,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,126 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b 2023-02-14 11:02:39,126 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41671 2023-02-14 11:02:39,126 DEBUG [RS:1;jenkins-hbase4:38173] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38173 2023-02-14 11:02:39,126 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:39,126 INFO [RS:1;jenkins-hbase4:38173] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-14 11:02:39,126 INFO [RS:1;jenkins-hbase4:38173] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-14 11:02:39,126 DEBUG [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(1023): About to register with Master. 2023-02-14 11:02:39,127 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:39,127 INFO [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40235,1676372558813 with isa=jenkins-hbase4.apache.org/172.31.14.131:38173, startcode=1676372558886 2023-02-14 11:02:39,127 DEBUG [RS:0;jenkins-hbase4:41535] zookeeper.ZKUtil(162): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,127 DEBUG [RS:1;jenkins-hbase4:38173] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-14 11:02:39,127 WARN [RS:0;jenkins-hbase4:41535] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:39,128 INFO [RS:0;jenkins-hbase4:41535] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:39,128 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/WALs/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,128 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41535,1676372558856] 2023-02-14 11:02:39,130 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45843, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-14 11:02:39,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:39,132 DEBUG [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b 2023-02-14 11:02:39,132 DEBUG [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41671 2023-02-14 11:02:39,132 DEBUG [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-14 11:02:39,137 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:39,137 DEBUG [RS:0;jenkins-hbase4:41535] zookeeper.ZKUtil(162): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,137 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:39,137 DEBUG [RS:1;jenkins-hbase4:38173] zookeeper.ZKUtil(162): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:39,138 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38173,1676372558886] 2023-02-14 11:02:39,138 WARN [RS:1;jenkins-hbase4:38173] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-14 11:02:39,138 INFO [RS:1;jenkins-hbase4:38173] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:39,138 DEBUG [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/WALs/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:39,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,138 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:39,138 INFO [RS:0;jenkins-hbase4:41535] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:39,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:39,140 INFO [RS:0;jenkins-hbase4:41535] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:39,140 INFO [RS:0;jenkins-hbase4:41535] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:39,141 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,141 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:39,141 DEBUG [RS:1;jenkins-hbase4:38173] zookeeper.ZKUtil(162): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,143 DEBUG [RS:1;jenkins-hbase4:38173] zookeeper.ZKUtil(162): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:39,144 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,146 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,146 DEBUG [RS:1;jenkins-hbase4:38173] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-14 11:02:39,147 INFO [RS:1;jenkins-hbase4:38173] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-14 11:02:39,148 INFO [RS:1;jenkins-hbase4:38173] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-14 11:02:39,152 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,152 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,152 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,152 INFO [RS:1;jenkins-hbase4:38173] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-14 11:02:39,152 INFO [RS:1;jenkins-hbase4:38173] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,156 INFO [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-14 11:02:39,157 INFO [RS:1;jenkins-hbase4:38173] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,157 DEBUG [RS:1;jenkins-hbase4:38173] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-14 11:02:39,159 INFO [RS:1;jenkins-hbase4:38173] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,159 INFO [RS:1;jenkins-hbase4:38173] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,159 INFO [RS:1;jenkins-hbase4:38173] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,164 INFO [RS:0;jenkins-hbase4:41535] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:39,164 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41535,1676372558856-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,169 INFO [RS:1;jenkins-hbase4:38173] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-14 11:02:39,169 INFO [RS:1;jenkins-hbase4:38173] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38173,1676372558886-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,174 INFO [RS:0;jenkins-hbase4:41535] regionserver.Replication(203): jenkins-hbase4.apache.org,41535,1676372558856 started 2023-02-14 11:02:39,174 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41535,1676372558856, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41535, sessionid=0x100527f2d920001 2023-02-14 11:02:39,174 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41535,1676372558856' 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41535,1676372558856' 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:39,175 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:39,176 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:39,176 INFO [RS:0;jenkins-hbase4:41535] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:39,176 INFO [RS:0;jenkins-hbase4:41535] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:39,179 INFO [RS:1;jenkins-hbase4:38173] regionserver.Replication(203): jenkins-hbase4.apache.org,38173,1676372558886 started 2023-02-14 11:02:39,179 INFO [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38173,1676372558886, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38173, sessionid=0x100527f2d920002 2023-02-14 11:02:39,179 DEBUG [RS:1;jenkins-hbase4:38173] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-14 11:02:39,179 DEBUG [RS:1;jenkins-hbase4:38173] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:39,179 DEBUG [RS:1;jenkins-hbase4:38173] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38173,1676372558886' 2023-02-14 11:02:39,179 DEBUG [RS:1;jenkins-hbase4:38173] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:39,179 DEBUG [RS:1;jenkins-hbase4:38173] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:39,180 DEBUG [RS:1;jenkins-hbase4:38173] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-14 11:02:39,180 DEBUG [RS:1;jenkins-hbase4:38173] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-14 11:02:39,180 DEBUG [RS:1;jenkins-hbase4:38173] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:39,180 DEBUG [RS:1;jenkins-hbase4:38173] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38173,1676372558886' 2023-02-14 11:02:39,180 DEBUG [RS:1;jenkins-hbase4:38173] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:39,180 DEBUG [RS:1;jenkins-hbase4:38173] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:39,180 DEBUG [RS:1;jenkins-hbase4:38173] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-14 11:02:39,180 INFO [RS:1;jenkins-hbase4:38173] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-14 11:02:39,180 INFO [RS:1;jenkins-hbase4:38173] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-14 11:02:39,239 DEBUG [jenkins-hbase4:40235] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-14 11:02:39,239 DEBUG [jenkins-hbase4:40235] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:39,240 DEBUG [jenkins-hbase4:40235] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:39,241 DEBUG [jenkins-hbase4:40235] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:39,241 DEBUG [jenkins-hbase4:40235] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:39,241 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41535,1676372558856, state=OPENING 2023-02-14 11:02:39,242 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-14 11:02:39,243 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:39,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41535,1676372558856}] 2023-02-14 11:02:39,244 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:39,399 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,399 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-14 11:02:39,401 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36656, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-14 11:02:39,404 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-14 11:02:39,404 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-14 11:02:39,405 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41535%2C1676372558856.meta, suffix=.meta, logDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/WALs/jenkins-hbase4.apache.org,41535,1676372558856, archiveDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/oldWALs, maxLogs=32 2023-02-14 11:02:39,421 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46779,DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae,DISK] 2023-02-14 11:02:39,421 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38785,DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada,DISK] 2023-02-14 11:02:39,423 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/WALs/jenkins-hbase4.apache.org,41535,1676372558856/jenkins-hbase4.apache.org%2C41535%2C1676372558856.meta.1676372559406.meta 2023-02-14 11:02:39,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46779,DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae,DISK], DatanodeInfoWithStorage[127.0.0.1:38785,DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada,DISK]] 2023-02-14 11:02:39,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:39,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-14 11:02:39,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-14 11:02:39,424 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-14 11:02:39,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-14 11:02:39,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:39,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-14 11:02:39,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-14 11:02:39,425 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-14 11:02:39,426 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/info 2023-02-14 11:02:39,426 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/info 2023-02-14 11:02:39,426 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-14 11:02:39,427 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:39,427 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-14 11:02:39,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:39,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/rep_barrier 2023-02-14 11:02:39,428 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-14 11:02:39,428 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:39,428 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-14 11:02:39,429 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/table 2023-02-14 11:02:39,429 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/table 2023-02-14 11:02:39,429 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-14 11:02:39,430 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:39,430 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740 2023-02-14 11:02:39,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740 2023-02-14 11:02:39,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-14 11:02:39,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-14 11:02:39,434 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62984198, jitterRate=-0.06146231293678284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-14 11:02:39,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-14 11:02:39,434 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676372559399 2023-02-14 11:02:39,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-14 11:02:39,439 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-14 11:02:39,439 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41535,1676372558856, state=OPEN 2023-02-14 11:02:39,440 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-14 11:02:39,440 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-14 11:02:39,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-14 11:02:39,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41535,1676372558856 in 197 msec 2023-02-14 11:02:39,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-14 11:02:39,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-14 11:02:39,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 404 msec 2023-02-14 11:02:39,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676372559444, completionTime=-1 2023-02-14 11:02:39,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-14 11:02:39,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-14 11:02:39,447 DEBUG [hconnection-0x5a1993c9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:39,448 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:39,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-14 11:02:39,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676372619449 2023-02-14 11:02:39,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676372679449 2023-02-14 11:02:39,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-14 11:02:39,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40235,1676372558813-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40235,1676372558813-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40235,1676372558813-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40235, period=300000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-14 11:02:39,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-14 11:02:39,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:39,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-14 11:02:39,457 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-14 11:02:39,457 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:39,457 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:39,459 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:39,459 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2 empty. 2023-02-14 11:02:39,459 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:39,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-14 11:02:39,468 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:39,469 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a5af964e697d750c2d293742cbd9c1d2, NAME => 'hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp 2023-02-14 11:02:39,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:39,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a5af964e697d750c2d293742cbd9c1d2, disabling compactions & flushes 2023-02-14 11:02:39,475 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:39,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:39,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. after waiting 0 ms 2023-02-14 11:02:39,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:39,475 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:39,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a5af964e697d750c2d293742cbd9c1d2: 2023-02-14 11:02:39,476 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:39,477 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372559477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372559477"}]},"ts":"1676372559477"} 2023-02-14 11:02:39,479 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:39,479 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:39,479 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372559479"}]},"ts":"1676372559479"} 2023-02-14 11:02:39,480 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-14 11:02:39,483 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:39,483 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:39,483 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:39,483 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:39,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a5af964e697d750c2d293742cbd9c1d2, ASSIGN}] 2023-02-14 11:02:39,486 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a5af964e697d750c2d293742cbd9c1d2, ASSIGN 2023-02-14 11:02:39,486 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a5af964e697d750c2d293742cbd9c1d2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41535,1676372558856; forceNewPlan=false, retain=false 2023-02-14 11:02:39,637 INFO [jenkins-hbase4:40235] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:39,637 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a5af964e697d750c2d293742cbd9c1d2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,637 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372559637"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372559637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372559637"}]},"ts":"1676372559637"} 2023-02-14 11:02:39,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a5af964e697d750c2d293742cbd9c1d2, server=jenkins-hbase4.apache.org,41535,1676372558856}] 2023-02-14 11:02:39,796 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:39,797 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41535%2C1676372558856, suffix=, logDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/WALs/jenkins-hbase4.apache.org,41535,1676372558856, archiveDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/oldWALs, maxLogs=32 2023-02-14 11:02:39,810 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38785,DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada,DISK] 2023-02-14 11:02:39,810 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46779,DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae,DISK] 2023-02-14 11:02:39,812 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/WALs/jenkins-hbase4.apache.org,41535,1676372558856/jenkins-hbase4.apache.org%2C41535%2C1676372558856.1676372559797 2023-02-14 11:02:39,813 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46779,DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae,DISK], DatanodeInfoWithStorage[127.0.0.1:38785,DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada,DISK]] 2023-02-14 11:02:39,813 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a5af964e697d750c2d293742cbd9c1d2, NAME => 'hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:39,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:39,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:39,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:39,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:39,815 INFO [StoreOpener-a5af964e697d750c2d293742cbd9c1d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:39,816 DEBUG [StoreOpener-a5af964e697d750c2d293742cbd9c1d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2/info 2023-02-14 11:02:39,816 DEBUG [StoreOpener-a5af964e697d750c2d293742cbd9c1d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2/info 2023-02-14 11:02:39,816 INFO [StoreOpener-a5af964e697d750c2d293742cbd9c1d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5af964e697d750c2d293742cbd9c1d2 columnFamilyName info 2023-02-14 11:02:39,816 INFO [StoreOpener-a5af964e697d750c2d293742cbd9c1d2-1] regionserver.HStore(310): Store=a5af964e697d750c2d293742cbd9c1d2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:39,817 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:39,817 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:39,819 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:39,820 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:39,821 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a5af964e697d750c2d293742cbd9c1d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71624868, jitterRate=0.06729370355606079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-14 11:02:39,821 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a5af964e697d750c2d293742cbd9c1d2: 2023-02-14 11:02:39,821 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2., pid=6, masterSystemTime=1676372559790 2023-02-14 11:02:39,823 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:39,823 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:39,823 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a5af964e697d750c2d293742cbd9c1d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:39,823 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676372559823"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372559823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372559823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372559823"}]},"ts":"1676372559823"} 2023-02-14 11:02:39,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-14 11:02:39,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a5af964e697d750c2d293742cbd9c1d2, server=jenkins-hbase4.apache.org,41535,1676372558856 in 186 msec 2023-02-14 11:02:39,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-14 11:02:39,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a5af964e697d750c2d293742cbd9c1d2, ASSIGN in 342 msec 2023-02-14 11:02:39,827 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:39,827 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372559827"}]},"ts":"1676372559827"} 2023-02-14 11:02:39,828 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-14 11:02:39,831 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:39,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 376 msec 2023-02-14 11:02:39,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-14 11:02:39,858 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:39,858 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:39,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-14 11:02:39,866 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:39,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-14 11:02:39,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-14 11:02:39,881 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-14 11:02:39,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-14 11:02:39,895 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-14 11:02:39,897 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-14 11:02:39,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.987sec 2023-02-14 11:02:39,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-14 11:02:39,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-14 11:02:39,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-14 11:02:39,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40235,1676372558813-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-14 11:02:39,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40235,1676372558813-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-14 11:02:39,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-14 11:02:39,903 DEBUG [Listener at localhost/43505] zookeeper.ReadOnlyZKClient(139): Connect 0x765e3041 to 127.0.0.1:49570 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:39,906 DEBUG [Listener at localhost/43505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@674ad16c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:39,908 DEBUG [hconnection-0x3b82bc1a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:39,909 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:39,910 INFO [Listener at localhost/43505] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:39,910 DEBUG [Listener at localhost/43505] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-14 11:02:39,913 DEBUG [Listener at localhost/43505] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-14 11:02:39,914 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-14 11:02:39,914 INFO [Listener at localhost/43505] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-14 11:02:39,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-14 11:02:39,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-14 11:02:39,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:36284 deadline: 1676372619914, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-14 11:02:39,915 INFO [Listener at localhost/43505] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-14 11:02:39,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-14 11:02:39,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-14 11:02:39,919 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-14 11:02:39,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-14 11:02:39,919 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-14 11:02:39,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:39,920 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:39,921 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255 empty. 2023-02-14 11:02:39,921 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:39,921 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-14 11:02:39,930 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-14 11:02:39,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ae237ba1f26334b9ab3624f9c1519255, NAME => 'testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp 2023-02-14 11:02:39,936 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:39,936 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ae237ba1f26334b9ab3624f9c1519255, disabling compactions & flushes 2023-02-14 11:02:39,936 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:39,936 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:39,936 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. after waiting 0 ms 2023-02-14 11:02:39,936 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:39,936 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:39,936 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ae237ba1f26334b9ab3624f9c1519255: 2023-02-14 11:02:39,938 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-14 11:02:39,939 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676372559939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372559939"}]},"ts":"1676372559939"} 2023-02-14 11:02:39,940 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-14 11:02:39,940 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-14 11:02:39,941 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372559940"}]},"ts":"1676372559940"} 2023-02-14 11:02:39,941 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-14 11:02:39,945 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-14 11:02:39,945 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-14 11:02:39,945 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-14 11:02:39,945 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-14 11:02:39,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ae237ba1f26334b9ab3624f9c1519255, ASSIGN}] 2023-02-14 11:02:39,949 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ae237ba1f26334b9ab3624f9c1519255, ASSIGN 2023-02-14 11:02:39,949 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ae237ba1f26334b9ab3624f9c1519255, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41535,1676372558856; forceNewPlan=false, retain=false 2023-02-14 11:02:40,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:40,099 INFO [jenkins-hbase4:40235] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-14 11:02:40,100 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ae237ba1f26334b9ab3624f9c1519255, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,100 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676372560100"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372560100"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372560100"}]},"ts":"1676372560100"} 2023-02-14 11:02:40,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure ae237ba1f26334b9ab3624f9c1519255, server=jenkins-hbase4.apache.org,41535,1676372558856}] 2023-02-14 11:02:40,182 INFO [RS:1;jenkins-hbase4:38173] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38173%2C1676372558886, suffix=, logDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/WALs/jenkins-hbase4.apache.org,38173,1676372558886, archiveDir=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/oldWALs, maxLogs=32 2023-02-14 11:02:40,196 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38785,DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada,DISK] 2023-02-14 11:02:40,197 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46779,DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae,DISK] 2023-02-14 11:02:40,198 INFO [RS:1;jenkins-hbase4:38173] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/WALs/jenkins-hbase4.apache.org,38173,1676372558886/jenkins-hbase4.apache.org%2C38173%2C1676372558886.1676372560182 2023-02-14 11:02:40,200 DEBUG [RS:1;jenkins-hbase4:38173] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46779,DS-eed48cf4-fd34-41e2-8f1f-a45987e98bae,DISK], DatanodeInfoWithStorage[127.0.0.1:38785,DS-6f075d09-b7a6-4ed2-bd0e-e5f3518ddada,DISK]] 2023-02-14 11:02:40,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:40,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:40,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ae237ba1f26334b9ab3624f9c1519255, NAME => 'testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.', STARTKEY => '', ENDKEY => ''} 2023-02-14 11:02:40,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:40,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:40,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:40,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:40,257 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:40,258 DEBUG [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1 2023-02-14 11:02:40,258 DEBUG [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1 2023-02-14 11:02:40,259 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae237ba1f26334b9ab3624f9c1519255 columnFamilyName f1 2023-02-14 11:02:40,259 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(310): Store=ae237ba1f26334b9ab3624f9c1519255/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:40,259 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:40,260 DEBUG [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2 2023-02-14 11:02:40,260 DEBUG [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2 2023-02-14 11:02:40,260 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae237ba1f26334b9ab3624f9c1519255 columnFamilyName f2 2023-02-14 11:02:40,261 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(310): Store=ae237ba1f26334b9ab3624f9c1519255/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:40,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:40,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:40,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:40,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:40,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-14 11:02:40,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ae237ba1f26334b9ab3624f9c1519255; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66352408, jitterRate=-0.011272072792053223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:40,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ae237ba1f26334b9ab3624f9c1519255: 2023-02-14 11:02:40,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255., pid=12, masterSystemTime=1676372560253 2023-02-14 11:02:40,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:40,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:40,268 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ae237ba1f26334b9ab3624f9c1519255, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,268 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676372560268"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676372560268"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676372560268"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676372560268"}]},"ts":"1676372560268"} 2023-02-14 11:02:40,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-14 11:02:40,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure ae237ba1f26334b9ab3624f9c1519255, server=jenkins-hbase4.apache.org,41535,1676372558856 in 168 msec 2023-02-14 11:02:40,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-14 11:02:40,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ae237ba1f26334b9ab3624f9c1519255, ASSIGN in 324 msec 2023-02-14 11:02:40,272 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-14 11:02:40,272 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372560272"}]},"ts":"1676372560272"} 2023-02-14 11:02:40,273 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-14 11:02:40,275 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-14 11:02:40,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 358 msec 2023-02-14 11:02:40,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-14 11:02:40,524 INFO [Listener at localhost/43505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-14 11:02:40,524 DEBUG [Listener at localhost/43505] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-14 11:02:40,525 INFO [Listener at localhost/43505] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:40,527 INFO [Listener at localhost/43505] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-14 11:02:40,527 INFO [Listener at localhost/43505] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-14 11:02:40,527 INFO [Listener at localhost/43505] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-14 11:02:40,527 INFO [Listener at localhost/43505] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-14 11:02:40,623 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41535] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:40,708 INFO [Listener at localhost/43505] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-14 11:02:40,708 INFO [Listener at localhost/43505] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-14 11:02:40,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-14 11:02:40,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676372560709 (current time:1676372560709). 2023-02-14 11:02:40,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-14 11:02:40,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] zookeeper.ReadOnlyZKClient(139): Connect 0x3c0267e0 to 127.0.0.1:49570 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-14 11:02:40,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4acb88b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-14 11:02:40,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-14 11:02:40,715 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36680, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-14 11:02:40,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c0267e0 to 127.0.0.1:49570 2023-02-14 11:02:40,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:40,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-14 11:02:40,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-14 11:02:40,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-14 11:02:40,719 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-14 11:02:40,720 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676373160720 2023-02-14 11:02:40,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-14 11:02:40,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-14 11:02:40,721 DEBUG [Listener at localhost/43505] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:40,721 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-14 11:02:40,721 DEBUG [Listener at localhost/43505] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-14 11:02:40,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-14 11:02:40,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-14 11:02:40,723 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-14 11:02:40,724 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676373160723 2023-02-14 11:02:40,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-14 11:02:40,731 INFO [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-14 11:02:40,731 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:40,732 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-14 11:02:40,733 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-14 11:02:40,733 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,733 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-14 11:02:40,735 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:40,735 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:40,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:40,735 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:40,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:40,736 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,736 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-14 11:02:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-14 11:02:40,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-14 11:02:40,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-14 11:02:40,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-14 11:02:40,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-14 11:02:40,737 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-14 11:02:40,737 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-14 11:02:40,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-14 11:02:40,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-14 11:02:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-14 11:02:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-14 11:02:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-14 11:02:40,738 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-14 11:02:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-14 11:02:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-14 11:02:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-14 11:02:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38173,1676372558886' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-14 11:02:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41535,1676372558856' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-14 11:02:40,742 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,742 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:40,742 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,742 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,743 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:40,743 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:40,743 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:40,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:40,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-14 11:02:40,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:40,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:40,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41535,1676372558856' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-14 11:02:40,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@665ca5d6[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:40,744 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-14 11:02:40,744 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,745 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,745 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,745 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,745 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:40,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,745 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-14 11:02:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-14 11:02:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-14 11:02:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38173,1676372558886' in zk 2023-02-14 11:02:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-14 11:02:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-14 11:02:40,746 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:40,746 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. started... 2023-02-14 11:02:40,746 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ae237ba1f26334b9ab3624f9c1519255 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-14 11:02:40,747 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-14 11:02:40,747 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:40,747 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-14 11:02:40,766 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/.tmp/f1/52ecb1c17aa44a839ec3dbdb36296483 2023-02-14 11:02:40,791 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/.tmp/f2/2c19c8ae9e514796baf1e388dd198f7b 2023-02-14 11:02:40,795 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/.tmp/f1/52ecb1c17aa44a839ec3dbdb36296483 as hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/52ecb1c17aa44a839ec3dbdb36296483 2023-02-14 11:02:40,799 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/52ecb1c17aa44a839ec3dbdb36296483, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-14 11:02:40,800 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/.tmp/f2/2c19c8ae9e514796baf1e388dd198f7b as hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/2c19c8ae9e514796baf1e388dd198f7b 2023-02-14 11:02:40,803 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/2c19c8ae9e514796baf1e388dd198f7b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-14 11:02:40,804 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for ae237ba1f26334b9ab3624f9c1519255 in 58ms, sequenceid=5, compaction requested=false 2023-02-14 11:02:40,804 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ae237ba1f26334b9ab3624f9c1519255: 2023-02-14 11:02:40,804 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-14 11:02:40,804 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-14 11:02:40,804 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/52ecb1c17aa44a839ec3dbdb36296483] hfiles 2023-02-14 11:02:40,804 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/52ecb1c17aa44a839ec3dbdb36296483 for snapshot=testWithMapReduceSingleRegion 2023-02-14 11:02:40,804 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/2c19c8ae9e514796baf1e388dd198f7b] hfiles 2023-02-14 11:02:40,804 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/2c19c8ae9e514796baf1e388dd198f7b for snapshot=testWithMapReduceSingleRegion 2023-02-14 11:02:40,810 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. completed. 2023-02-14 11:02:40,810 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:40,810 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-14 11:02:40,810 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-14 11:02:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-14 11:02:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41535,1676372558856' in zk 2023-02-14 11:02:40,813 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-14 11:02:40,813 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,813 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:40,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:40,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:40,813 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-14 11:02:40,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:40,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:40,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-14 11:02:40,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:40,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:40,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-14 11:02:40,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:40,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,41535,1676372558856': 2023-02-14 11:02:40,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41535,1676372558856' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-14 11:02:40,816 INFO [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-14 11:02:40,816 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:40,816 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:40,816 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-14 11:02:40,816 INFO [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-14 11:02:40,818 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,818 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,818 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:40,818 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,818 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-14 11:02:40,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:40,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:40,819 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:40,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,819 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:40,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-14 11:02:40,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:40,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-14 11:02:40,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:40,820 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:40,821 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-14 11:02:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:40,822 DEBUG [Listener at localhost/43505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:40,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:02:40,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-14 11:02:40,823 DEBUG [Listener at localhost/43505] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-14 11:02:40,826 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:40,826 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:40,826 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-14 11:02:40,826 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-14 11:02:40,826 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:40,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-14 11:02:40,826 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-14 11:02:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-14 11:02:40,826 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:40,828 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:40,828 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,828 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-14 11:02:40,828 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-14 11:02:40,828 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:40,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-14 11:02:40,828 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:40,829 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-14 11:02:40,829 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-14 11:02:40,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:40,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:40,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-14 11:02:40,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-14 11:02:40,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-14 11:02:40,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-14 11:02:40,853 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-14 11:02:40,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-14 11:02:40,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-14 11:02:40,870 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-14 11:02:40,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676372560720Consolidate snapshot: testWithMapReduceSingleRegion at 1676372560829 (+109 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676372560829Writing data manifest for testWithMapReduceSingleRegion at 1676372560831 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676372560837 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676372560870 (+33 ms) 2023-02-14 11:02:40,872 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-14 11:02:40,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 151 msec 2023-02-14 11:02:41,023 DEBUG [Listener at localhost/43505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-14 11:02:41,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-14 11:02:41,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-14 11:02:41,025 INFO [Listener at localhost/43505] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-14 11:02:41,029 INFO [Listener at localhost/43505] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-14 11:02:41,033 INFO [Listener at localhost/43505] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-14 11:02:41,068 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41535] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:41,159 INFO [Listener at localhost/43505] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-14 11:02:41,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-14 11:02:41,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-14 11:02:41,166 INFO [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-14 11:02:41,166 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:41,166 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-14 11:02:41,166 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-14 11:02:41,166 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,166 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:41,168 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:41,168 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:41,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:41,169 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:41,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:41,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:41,169 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,169 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-14 11:02:41,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:41,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:41,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-14 11:02:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:41,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-14 11:02:41,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-14 11:02:41,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-14 11:02:41,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-14 11:02:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-14 11:02:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-14 11:02:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-14 11:02:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-14 11:02:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-14 11:02:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38173,1676372558886' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-14 11:02:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-14 11:02:41,171 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-14 11:02:41,171 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-14 11:02:41,171 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:41,171 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. started... 2023-02-14 11:02:41,171 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ae237ba1f26334b9ab3624f9c1519255 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-14 11:02:41,172 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,172 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,172 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:41,185 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/.tmp/f1/3893fbd42bce4c8aae69152c11cc162e 2023-02-14 11:02:41,210 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/.tmp/f2/3b987e07e6964db0bfe15725ddf43c67 2023-02-14 11:02:41,216 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/.tmp/f1/3893fbd42bce4c8aae69152c11cc162e as hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/3893fbd42bce4c8aae69152c11cc162e 2023-02-14 11:02:41,221 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/3893fbd42bce4c8aae69152c11cc162e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-14 11:02:41,221 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/.tmp/f2/3b987e07e6964db0bfe15725ddf43c67 as hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/3b987e07e6964db0bfe15725ddf43c67 2023-02-14 11:02:41,226 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/3b987e07e6964db0bfe15725ddf43c67, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-14 11:02:41,227 INFO [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for ae237ba1f26334b9ab3624f9c1519255 in 56ms, sequenceid=9, compaction requested=false 2023-02-14 11:02:41,227 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ae237ba1f26334b9ab3624f9c1519255: 2023-02-14 11:02:41,227 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676372558856)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-14 11:02:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-14 11:02:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-14 11:02:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41535,1676372558856' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-14 11:02:41,229 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,229 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:41,229 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,229 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-14 11:02:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:41,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:41,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:41,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:41,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41535,1676372558856' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-14 11:02:41,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62633dc5[Count = 0] remaining members to acquire global barrier 2023-02-14 11:02:41,231 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-14 11:02:41,231 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,232 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,232 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-14 11:02:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-14 11:02:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-14 11:02:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-14 11:02:41,232 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,232 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-14 11:02:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41535,1676372558856' in zk 2023-02-14 11:02:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38173,1676372558886' in zk 2023-02-14 11:02:41,235 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-14 11:02:41,235 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:41,235 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-14 11:02:41,235 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,235 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:41,235 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676372558856' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-14 11:02:41,235 DEBUG [member: 'jenkins-hbase4.apache.org,38173,1676372558886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-14 11:02:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41535,1676372558856': 2023-02-14 11:02:41,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41535,1676372558856' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-14 11:02:41,237 INFO [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-14 11:02:41,237 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-14 11:02:41,237 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-14 11:02:41,237 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-14 11:02:41,238 INFO [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-14 11:02:41,239 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,239 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,239 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,239 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-14 11:02:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-14 11:02:41,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,239 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:41,239 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-14 11:02:41,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:41,240 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-14 11:02:41,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:41,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:41,241 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-14 11:02:41,242 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:41,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-14 11:02:41,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-14 11:02:41,244 DEBUG [(jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-14 11:02:41,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-14 11:02:41,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:41,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-14 11:02:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:41,244 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,245 DEBUG [Listener at localhost/43505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-14 11:02:41,245 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:41,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:41,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:41,245 DEBUG [Listener at localhost/43505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-14 11:02:41,245 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-14 11:02:41,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-14 11:02:41,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-14 11:02:41,245 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-14 11:02:41,345 DEBUG [Listener at localhost/43505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-14 11:02:41,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-14 11:02:41,432 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/hadoop-459441988494191594.jar 2023-02-14 11:02:41,435 INFO [Listener at localhost/43505] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676372560709 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:41,436 DEBUG [Listener at localhost/43505] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41671/user/jenkins/test-data/91e5a7cd-d6c2-f6ec-0298-b20a2182f9b2/testWithMapReduceSingleRegion/1d178277-7d6a-425d-9920-701d34da7c45/data/default/testWithMapReduce 2023-02-14 11:02:41,436 INFO [Listener at localhost/43505] snapshot.RestoreSnapshotHelper(239): region to add: ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:41,436 INFO [Listener at localhost/43505] snapshot.RestoreSnapshotHelper(585): clone region=ae237ba1f26334b9ab3624f9c1519255 as ae237ba1f26334b9ab3624f9c1519255 in snapshot testWithMapReduceSingleRegion 2023-02-14 11:02:41,437 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ae237ba1f26334b9ab3624f9c1519255, NAME => 'testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41671/user/jenkins/test-data/91e5a7cd-d6c2-f6ec-0298-b20a2182f9b2/testWithMapReduceSingleRegion/1d178277-7d6a-425d-9920-701d34da7c45 2023-02-14 11:02:41,443 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:41,443 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 52ecb1c17aa44a839ec3dbdb36296483 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-14 11:02:41,444 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2c19c8ae9e514796baf1e388dd198f7b from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-14 11:02:41,446 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ae237ba1f26334b9ab3624f9c1519255, disabling compactions & flushes 2023-02-14 11:02:41,446 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:41,446 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:41,446 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. after waiting 0 ms 2023-02-14 11:02:41,446 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:41,446 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:41,446 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ae237ba1f26334b9ab3624f9c1519255: 2023-02-14 11:02:41,446 INFO [Listener at localhost/43505] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676372560709 type: FLUSH version: 2 ttl: 0 2023-02-14 11:02:41,446 DEBUG [Listener at localhost/43505] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41671/user/jenkins/test-data/91e5a7cd-d6c2-f6ec-0298-b20a2182f9b2/testWithMapReduceSingleRegion/1d178277-7d6a-425d-9920-701d34da7c45 2023-02-14 11:02:41,446 DEBUG [Listener at localhost/43505] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41671/user/jenkins/test-data/91e5a7cd-d6c2-f6ec-0298-b20a2182f9b2/testWithMapReduceSingleRegion/1d178277-7d6a-425d-9920-701d34da7c45 2023-02-14 11:02:41,447 DEBUG [Listener at localhost/43505] util.CommonFSUtils(699): |-data/ 2023-02-14 11:02:41,447 DEBUG [Listener at localhost/43505] util.CommonFSUtils(699): |----default/ 2023-02-14 11:02:41,447 DEBUG [Listener at localhost/43505] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-14 11:02:41,448 DEBUG [Listener at localhost/43505] util.CommonFSUtils(699): |----------ae237ba1f26334b9ab3624f9c1519255/ 2023-02-14 11:02:41,448 DEBUG [Listener at localhost/43505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-14 11:02:41,448 DEBUG [Listener at localhost/43505] util.CommonFSUtils(699): |-------------f1/ 2023-02-14 11:02:41,449 DEBUG [Listener at localhost/43505] util.CommonFSUtils(702): |----------------testWithMapReduce=ae237ba1f26334b9ab3624f9c1519255-52ecb1c17aa44a839ec3dbdb36296483 2023-02-14 11:02:41,449 DEBUG [Listener at localhost/43505] util.CommonFSUtils(699): |-------------f2/ 2023-02-14 11:02:41,449 DEBUG [Listener at localhost/43505] util.CommonFSUtils(702): |----------------testWithMapReduce=ae237ba1f26334b9ab3624f9c1519255-2c19c8ae9e514796baf1e388dd198f7b 2023-02-14 11:02:41,449 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:41,450 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:41,450 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:41,451 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,460 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/hadoop-6565318793852256762.jar 2023-02-14 11:02:42,461 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,461 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,539 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/hadoop-9082449626079236542.jar 2023-02-14 11:02:42,540 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,540 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,541 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,541 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,541 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,542 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,542 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-14 11:02:42,542 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-14 11:02:42,543 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-14 11:02:42,543 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-14 11:02:42,543 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-14 11:02:42,544 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-14 11:02:42,544 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-14 11:02:42,545 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-14 11:02:42,545 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-14 11:02:42,545 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-14 11:02:42,546 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-14 11:02:42,546 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-14 11:02:42,547 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-14 11:02:42,547 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-14 11:02:42,548 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-14 11:02:42,626 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/hadoop-1587202941166680392.jar 2023-02-14 11:02:42,627 DEBUG [Listener at localhost/43505] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-14 11:02:42,632 WARN [Listener at localhost/43505] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-14 11:02:42,663 WARN [Listener at localhost/43505] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-14 11:02:42,679 INFO [Listener at localhost/43505] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-14 11:02:42,806 WARN [Listener at localhost/43505] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/mapreduce.cluster.local.dir/1676372562756/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-14 11:02:42,806 WARN [Listener at localhost/43505] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/mapreduce.cluster.local.dir/1676372562756/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-14 11:02:42,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-14 11:02:42,842 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-14 11:02:42,842 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-14 11:02:42,845 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:42,845 DEBUG [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/91e5a7cd-d6c2-f6ec-0298-b20a2182f9b2/testWithMapReduceSingleRegion/1d178277-7d6a-425d-9920-701d34da7c45/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1 2023-02-14 11:02:42,846 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae237ba1f26334b9ab3624f9c1519255 columnFamilyName f1 2023-02-14 11:02:42,850 DEBUG [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(539): loaded hdfs://localhost:41671/user/jenkins/test-data/91e5a7cd-d6c2-f6ec-0298-b20a2182f9b2/testWithMapReduceSingleRegion/1d178277-7d6a-425d-9920-701d34da7c45/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/testWithMapReduce=ae237ba1f26334b9ab3624f9c1519255-52ecb1c17aa44a839ec3dbdb36296483 2023-02-14 11:02:42,850 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(310): Store=ae237ba1f26334b9ab3624f9c1519255/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:42,850 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:42,851 DEBUG [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41671/user/jenkins/test-data/91e5a7cd-d6c2-f6ec-0298-b20a2182f9b2/testWithMapReduceSingleRegion/1d178277-7d6a-425d-9920-701d34da7c45/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2 2023-02-14 11:02:42,852 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae237ba1f26334b9ab3624f9c1519255 columnFamilyName f2 2023-02-14 11:02:42,856 DEBUG [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(539): loaded hdfs://localhost:41671/user/jenkins/test-data/91e5a7cd-d6c2-f6ec-0298-b20a2182f9b2/testWithMapReduceSingleRegion/1d178277-7d6a-425d-9920-701d34da7c45/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/testWithMapReduce=ae237ba1f26334b9ab3624f9c1519255-2c19c8ae9e514796baf1e388dd198f7b 2023-02-14 11:02:42,856 INFO [StoreOpener-ae237ba1f26334b9ab3624f9c1519255-1] regionserver.HStore(310): Store=ae237ba1f26334b9ab3624f9c1519255/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-14 11:02:42,856 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-14 11:02:42,857 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ae237ba1f26334b9ab3624f9c1519255; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62807677, jitterRate=-0.06409268081188202}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-14 11:02:42,857 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ae237ba1f26334b9ab3624f9c1519255: 2023-02-14 11:02:43,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ae237ba1f26334b9ab3624f9c1519255, disabling compactions & flushes 2023-02-14 11:02:43,005 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:43,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:43,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. after waiting 0 ms 2023-02-14 11:02:43,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:43,007 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:43,007 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ae237ba1f26334b9ab3624f9c1519255: 2023-02-14 11:02:43,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-14 11:02:43,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-14 11:02:43,849 INFO [Listener at localhost/43505] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-14 11:02:43,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-14 11:02:43,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-14 11:02:43,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:43,853 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372563853"}]},"ts":"1676372563853"} 2023-02-14 11:02:43,854 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-14 11:02:43,856 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-14 11:02:43,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ae237ba1f26334b9ab3624f9c1519255, UNASSIGN}] 2023-02-14 11:02:43,857 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ae237ba1f26334b9ab3624f9c1519255, UNASSIGN 2023-02-14 11:02:43,858 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ae237ba1f26334b9ab3624f9c1519255, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:43,858 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676372563858"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676372563858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676372563858"}]},"ts":"1676372563858"} 2023-02-14 11:02:43,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure ae237ba1f26334b9ab3624f9c1519255, server=jenkins-hbase4.apache.org,41535,1676372558856}] 2023-02-14 11:02:43,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:44,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:44,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ae237ba1f26334b9ab3624f9c1519255, disabling compactions & flushes 2023-02-14 11:02:44,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:44,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:44,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. after waiting 0 ms 2023-02-14 11:02:44,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:44,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-14 11:02:44,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255. 2023-02-14 11:02:44,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ae237ba1f26334b9ab3624f9c1519255: 2023-02-14 11:02:44,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:44,027 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ae237ba1f26334b9ab3624f9c1519255, regionState=CLOSED 2023-02-14 11:02:44,027 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676372564027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676372564027"}]},"ts":"1676372564027"} 2023-02-14 11:02:44,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-14 11:02:44,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure ae237ba1f26334b9ab3624f9c1519255, server=jenkins-hbase4.apache.org,41535,1676372558856 in 170 msec 2023-02-14 11:02:44,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-14 11:02:44,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ae237ba1f26334b9ab3624f9c1519255, UNASSIGN in 173 msec 2023-02-14 11:02:44,032 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676372564032"}]},"ts":"1676372564032"} 2023-02-14 11:02:44,033 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-14 11:02:44,034 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-14 11:02:44,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 184 msec 2023-02-14 11:02:44,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-14 11:02:44,156 INFO [Listener at localhost/43505] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-14 11:02:44,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-14 11:02:44,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:44,161 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:44,161 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:44,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-14 11:02:44,166 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:44,168 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1, FileablePath, hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2, FileablePath, hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/recovered.edits] 2023-02-14 11:02:44,174 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/3893fbd42bce4c8aae69152c11cc162e to hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/archive/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/3893fbd42bce4c8aae69152c11cc162e 2023-02-14 11:02:44,176 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/52ecb1c17aa44a839ec3dbdb36296483 to hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/archive/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f1/52ecb1c17aa44a839ec3dbdb36296483 2023-02-14 11:02:44,179 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/2c19c8ae9e514796baf1e388dd198f7b to hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/archive/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/2c19c8ae9e514796baf1e388dd198f7b 2023-02-14 11:02:44,181 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/3b987e07e6964db0bfe15725ddf43c67 to hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/archive/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/f2/3b987e07e6964db0bfe15725ddf43c67 2023-02-14 11:02:44,188 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/recovered.edits/12.seqid to hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/archive/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255/recovered.edits/12.seqid 2023-02-14 11:02:44,189 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/.tmp/data/default/testWithMapReduce/ae237ba1f26334b9ab3624f9c1519255 2023-02-14 11:02:44,189 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-14 11:02:44,191 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:44,195 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-14 11:02:44,197 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-14 11:02:44,198 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:44,198 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-14 11:02:44,199 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676372564199"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:44,205 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-14 11:02:44,205 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ae237ba1f26334b9ab3624f9c1519255, NAME => 'testWithMapReduce,,1676372559917.ae237ba1f26334b9ab3624f9c1519255.', STARTKEY => '', ENDKEY => ''}] 2023-02-14 11:02:44,205 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-14 11:02:44,205 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676372564205"}]},"ts":"9223372036854775807"} 2023-02-14 11:02:44,207 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-14 11:02:44,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-14 11:02:44,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 52 msec 2023-02-14 11:02:44,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40235] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-14 11:02:44,265 INFO [Listener at localhost/43505] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-14 11:02:44,265 INFO [Listener at localhost/43505] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-14 11:02:44,265 INFO [Listener at localhost/43505] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-14 11:02:44,265 DEBUG [Listener at localhost/43505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x765e3041 to 127.0.0.1:49570 2023-02-14 11:02:44,266 DEBUG [Listener at localhost/43505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:44,266 DEBUG [Listener at localhost/43505] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-14 11:02:44,266 DEBUG [Listener at localhost/43505] util.JVMClusterUtil(257): Found active master hash=838512144, stopped=false 2023-02-14 11:02:44,266 INFO [Listener at localhost/43505] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:44,273 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:44,273 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:44,273 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-14 11:02:44,273 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:44,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:44,274 INFO [Listener at localhost/43505] procedure2.ProcedureExecutor(629): Stopping 2023-02-14 11:02:44,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:44,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-14 11:02:44,277 DEBUG [Listener at localhost/43505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ccde700 to 127.0.0.1:49570 2023-02-14 11:02:44,277 DEBUG [Listener at localhost/43505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:44,277 INFO [Listener at localhost/43505] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41535,1676372558856' ***** 2023-02-14 11:02:44,278 INFO [Listener at localhost/43505] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:44,278 INFO [Listener at localhost/43505] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38173,1676372558886' ***** 2023-02-14 11:02:44,278 INFO [Listener at localhost/43505] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-14 11:02:44,278 INFO [RS:0;jenkins-hbase4:41535] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:44,278 INFO [RS:0;jenkins-hbase4:41535] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:44,279 INFO [RS:0;jenkins-hbase4:41535] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:44,279 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(3304): Received CLOSE for a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:44,279 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:44,279 DEBUG [RS:0;jenkins-hbase4:41535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f1df2e1 to 127.0.0.1:49570 2023-02-14 11:02:44,279 DEBUG [RS:0;jenkins-hbase4:41535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:44,279 INFO [RS:0;jenkins-hbase4:41535] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:44,279 INFO [RS:1;jenkins-hbase4:38173] regionserver.HeapMemoryManager(220): Stopping 2023-02-14 11:02:44,279 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:44,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a5af964e697d750c2d293742cbd9c1d2, disabling compactions & flushes 2023-02-14 11:02:44,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:44,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:44,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. after waiting 0 ms 2023-02-14 11:02:44,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:44,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a5af964e697d750c2d293742cbd9c1d2 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-14 11:02:44,281 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-14 11:02:44,282 INFO [RS:1;jenkins-hbase4:38173] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-14 11:02:44,282 INFO [RS:1;jenkins-hbase4:38173] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-14 11:02:44,282 INFO [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:44,282 DEBUG [RS:1;jenkins-hbase4:38173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a47cfff to 127.0.0.1:49570 2023-02-14 11:02:44,282 DEBUG [RS:1;jenkins-hbase4:38173] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:44,282 INFO [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38173,1676372558886; all regions closed. 2023-02-14 11:02:44,282 INFO [RS:0;jenkins-hbase4:41535] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:44,283 INFO [RS:0;jenkins-hbase4:41535] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:44,283 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-14 11:02:44,297 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-14 11:02:44,297 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1479): Online Regions={a5af964e697d750c2d293742cbd9c1d2=hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2., 1588230740=hbase:meta,,1.1588230740} 2023-02-14 11:02:44,297 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1505): Waiting on 1588230740, a5af964e697d750c2d293742cbd9c1d2 2023-02-14 11:02:44,298 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-14 11:02:44,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-14 11:02:44,298 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-14 11:02:44,298 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-14 11:02:44,298 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-14 11:02:44,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-14 11:02:44,306 DEBUG [RS:1;jenkins-hbase4:38173] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/oldWALs 2023-02-14 11:02:44,306 INFO [RS:1;jenkins-hbase4:38173] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38173%2C1676372558886:(num 1676372560182) 2023-02-14 11:02:44,307 DEBUG [RS:1;jenkins-hbase4:38173] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:44,307 INFO [RS:1;jenkins-hbase4:38173] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:44,314 INFO [RS:1;jenkins-hbase4:38173] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:44,314 INFO [RS:1;jenkins-hbase4:38173] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-14 11:02:44,314 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:44,314 INFO [RS:1;jenkins-hbase4:38173] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-14 11:02:44,315 INFO [RS:1;jenkins-hbase4:38173] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-14 11:02:44,326 INFO [RS:1;jenkins-hbase4:38173] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38173 2023-02-14 11:02:44,326 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:44,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2/.tmp/info/97b9c509897d4dc3a43d55b5480efd05 2023-02-14 11:02:44,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2/.tmp/info/97b9c509897d4dc3a43d55b5480efd05 as hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2/info/97b9c509897d4dc3a43d55b5480efd05 2023-02-14 11:02:44,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2/info/97b9c509897d4dc3a43d55b5480efd05, entries=2, sequenceid=6, filesize=4.8 K 2023-02-14 11:02:44,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a5af964e697d750c2d293742cbd9c1d2 in 70ms, sequenceid=6, compaction requested=false 2023-02-14 11:02:44,356 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:44,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/namespace/a5af964e697d750c2d293742cbd9c1d2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-14 11:02:44,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:44,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a5af964e697d750c2d293742cbd9c1d2: 2023-02-14 11:02:44,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676372559455.a5af964e697d750c2d293742cbd9c1d2. 2023-02-14 11:02:44,403 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:44,403 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:44,403 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:44,403 ERROR [Listener at localhost/43505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@686156d8 rejected from java.util.concurrent.ThreadPoolExecutor@6c5edf0c[Shutting down, pool size = 1, active threads = 0, queued tasks = 1, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:44,403 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38173,1676372558886 2023-02-14 11:02:44,403 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:44,497 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-14 11:02:44,501 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38173,1676372558886] 2023-02-14 11:02:44,501 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38173,1676372558886; numProcessing=1 2023-02-14 11:02:44,502 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38173,1676372558886 already deleted, retry=false 2023-02-14 11:02:44,502 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38173,1676372558886 expired; onlineServers=1 2023-02-14 11:02:44,602 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:44,602 INFO [RS:1;jenkins-hbase4:38173] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38173,1676372558886; zookeeper connection closed. 2023-02-14 11:02:44,602 ERROR [Listener at localhost/43505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a8a08e0 rejected from java.util.concurrent.ThreadPoolExecutor@6c5edf0c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:44,602 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:38173-0x100527f2d920002, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:44,602 ERROR [Listener at localhost/43505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2035c4b rejected from java.util.concurrent.ThreadPoolExecutor@6c5edf0c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:44,602 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@f58ca5c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@f58ca5c 2023-02-14 11:02:44,698 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-14 11:02:44,762 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/.tmp/info/cc6d7fd01bd447ccb0de542a203c8e8e 2023-02-14 11:02:44,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc6d7fd01bd447ccb0de542a203c8e8e 2023-02-14 11:02:44,783 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/.tmp/rep_barrier/9975eee2084547c5960de01f71cea222 2023-02-14 11:02:44,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9975eee2084547c5960de01f71cea222 2023-02-14 11:02:44,808 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/.tmp/table/961a8f7d70e744c6891a66be23d1cb89 2023-02-14 11:02:44,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 961a8f7d70e744c6891a66be23d1cb89 2023-02-14 11:02:44,812 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/.tmp/info/cc6d7fd01bd447ccb0de542a203c8e8e as hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/info/cc6d7fd01bd447ccb0de542a203c8e8e 2023-02-14 11:02:44,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc6d7fd01bd447ccb0de542a203c8e8e 2023-02-14 11:02:44,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/info/cc6d7fd01bd447ccb0de542a203c8e8e, entries=12, sequenceid=21, filesize=6.2 K 2023-02-14 11:02:44,817 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/.tmp/rep_barrier/9975eee2084547c5960de01f71cea222 as hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/rep_barrier/9975eee2084547c5960de01f71cea222 2023-02-14 11:02:44,822 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9975eee2084547c5960de01f71cea222 2023-02-14 11:02:44,822 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/rep_barrier/9975eee2084547c5960de01f71cea222, entries=1, sequenceid=21, filesize=5.0 K 2023-02-14 11:02:44,823 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/.tmp/table/961a8f7d70e744c6891a66be23d1cb89 as hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/table/961a8f7d70e744c6891a66be23d1cb89 2023-02-14 11:02:44,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 961a8f7d70e744c6891a66be23d1cb89 2023-02-14 11:02:44,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/table/961a8f7d70e744c6891a66be23d1cb89, entries=4, sequenceid=21, filesize=5.0 K 2023-02-14 11:02:44,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 531ms, sequenceid=21, compaction requested=false 2023-02-14 11:02:44,836 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-14 11:02:44,837 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-14 11:02:44,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:44,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-14 11:02:44,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-14 11:02:44,898 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41535,1676372558856; all regions closed. 2023-02-14 11:02:44,903 DEBUG [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/oldWALs 2023-02-14 11:02:44,904 INFO [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41535%2C1676372558856.meta:.meta(num 1676372559406) 2023-02-14 11:02:44,907 DEBUG [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/oldWALs 2023-02-14 11:02:44,907 INFO [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41535%2C1676372558856:(num 1676372559797) 2023-02-14 11:02:44,907 DEBUG [RS:0;jenkins-hbase4:41535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:44,907 INFO [RS:0;jenkins-hbase4:41535] regionserver.LeaseManager(133): Closed leases 2023-02-14 11:02:44,907 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-14 11:02:44,907 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:44,909 INFO [RS:0;jenkins-hbase4:41535] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41535 2023-02-14 11:02:44,914 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41535,1676372558856 2023-02-14 11:02:44,914 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-14 11:02:44,914 ERROR [Listener at localhost/43505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@32517f60 rejected from java.util.concurrent.ThreadPoolExecutor@366efdf2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:44,915 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41535,1676372558856] 2023-02-14 11:02:44,915 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41535,1676372558856; numProcessing=2 2023-02-14 11:02:44,918 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41535,1676372558856 already deleted, retry=false 2023-02-14 11:02:44,918 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41535,1676372558856 expired; onlineServers=0 2023-02-14 11:02:44,918 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40235,1676372558813' ***** 2023-02-14 11:02:44,918 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-14 11:02:44,919 DEBUG [M:0;jenkins-hbase4:40235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35c52cf7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-14 11:02:44,919 INFO [M:0;jenkins-hbase4:40235] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40235,1676372558813 2023-02-14 11:02:44,919 INFO [M:0;jenkins-hbase4:40235] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40235,1676372558813; all regions closed. 2023-02-14 11:02:44,919 DEBUG [M:0;jenkins-hbase4:40235] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-14 11:02:44,919 DEBUG [M:0;jenkins-hbase4:40235] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-14 11:02:44,919 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-14 11:02:44,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372559053] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676372559053,5,FailOnTimeoutGroup] 2023-02-14 11:02:44,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372559052] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676372559052,5,FailOnTimeoutGroup] 2023-02-14 11:02:44,919 DEBUG [M:0;jenkins-hbase4:40235] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-14 11:02:44,920 INFO [M:0;jenkins-hbase4:40235] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-14 11:02:44,920 INFO [M:0;jenkins-hbase4:40235] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-14 11:02:44,920 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-14 11:02:44,921 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-14 11:02:44,921 INFO [M:0;jenkins-hbase4:40235] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-14 11:02:44,921 DEBUG [M:0;jenkins-hbase4:40235] master.HMaster(1512): Stopping service threads 2023-02-14 11:02:44,921 INFO [M:0;jenkins-hbase4:40235] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-14 11:02:44,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-14 11:02:44,921 ERROR [M:0;jenkins-hbase4:40235] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-14 11:02:44,922 INFO [M:0;jenkins-hbase4:40235] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-14 11:02:44,922 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-14 11:02:44,922 DEBUG [M:0;jenkins-hbase4:40235] zookeeper.ZKUtil(398): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-14 11:02:44,922 WARN [M:0;jenkins-hbase4:40235] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-14 11:02:44,922 INFO [M:0;jenkins-hbase4:40235] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-14 11:02:44,923 INFO [M:0;jenkins-hbase4:40235] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-14 11:02:44,923 DEBUG [M:0;jenkins-hbase4:40235] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-14 11:02:44,923 INFO [M:0;jenkins-hbase4:40235] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:44,923 DEBUG [M:0;jenkins-hbase4:40235] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:44,923 DEBUG [M:0;jenkins-hbase4:40235] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-14 11:02:44,923 DEBUG [M:0;jenkins-hbase4:40235] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:44,923 INFO [M:0;jenkins-hbase4:40235] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.71 KB heapSize=65.67 KB 2023-02-14 11:02:44,942 INFO [M:0;jenkins-hbase4:40235] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d42ea7e926644863888be67d3c002f37 2023-02-14 11:02:44,951 DEBUG [M:0;jenkins-hbase4:40235] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d42ea7e926644863888be67d3c002f37 as hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d42ea7e926644863888be67d3c002f37 2023-02-14 11:02:44,954 INFO [M:0;jenkins-hbase4:40235] regionserver.HStore(1080): Added hdfs://localhost:41671/user/jenkins/test-data/921d544c-5e17-976f-4c96-f772191f430b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d42ea7e926644863888be67d3c002f37, entries=17, sequenceid=132, filesize=8.6 K 2023-02-14 11:02:44,955 INFO [M:0;jenkins-hbase4:40235] regionserver.HRegion(2947): Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=132, compaction requested=false 2023-02-14 11:02:44,955 INFO [M:0;jenkins-hbase4:40235] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-14 11:02:44,955 DEBUG [M:0;jenkins-hbase4:40235] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-14 11:02:44,958 INFO [M:0;jenkins-hbase4:40235] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-14 11:02:44,958 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-14 11:02:44,958 INFO [M:0;jenkins-hbase4:40235] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40235 2023-02-14 11:02:44,960 DEBUG [M:0;jenkins-hbase4:40235] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40235,1676372558813 already deleted, retry=false 2023-02-14 11:02:45,016 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:45,016 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41535,1676372558856; zookeeper connection closed. 2023-02-14 11:02:45,016 ERROR [Listener at localhost/43505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b46df32 rejected from java.util.concurrent.ThreadPoolExecutor@366efdf2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:45,016 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d15095f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d15095f 2023-02-14 11:02:45,016 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x100527f2d920001, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:45,016 ERROR [Listener at localhost/43505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@395f190 rejected from java.util.concurrent.ThreadPoolExecutor@366efdf2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:45,016 INFO [Listener at localhost/43505] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-14 11:02:45,116 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:45,116 INFO [M:0;jenkins-hbase4:40235] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40235,1676372558813; zookeeper connection closed. 2023-02-14 11:02:45,116 ERROR [Listener at localhost/43505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@54b77481 rejected from java.util.concurrent.ThreadPoolExecutor@5088eacf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:45,118 DEBUG [Listener at localhost/43505-EventThread] zookeeper.ZKWatcher(600): master:40235-0x100527f2d920000, quorum=127.0.0.1:49570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-14 11:02:45,118 ERROR [Listener at localhost/43505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b2968cd rejected from java.util.concurrent.ThreadPoolExecutor@5088eacf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-14 11:02:45,118 WARN [Listener at localhost/43505] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:45,124 INFO [Listener at localhost/43505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:45,229 WARN [BP-98008814-172.31.14.131-1676372558235 heartbeating to localhost/127.0.0.1:41671] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:45,229 WARN [BP-98008814-172.31.14.131-1676372558235 heartbeating to localhost/127.0.0.1:41671] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-98008814-172.31.14.131-1676372558235 (Datanode Uuid 2dc95637-91ab-42ee-902a-d37ff375e5c5) service to localhost/127.0.0.1:41671 2023-02-14 11:02:45,230 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/cluster_a2d6ce3e-9d73-edfb-92fb-e637f68f7292/dfs/data/data3/current/BP-98008814-172.31.14.131-1676372558235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:45,230 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/cluster_a2d6ce3e-9d73-edfb-92fb-e637f68f7292/dfs/data/data4/current/BP-98008814-172.31.14.131-1676372558235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:45,232 WARN [Listener at localhost/43505] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-14 11:02:45,237 INFO [Listener at localhost/43505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:45,339 WARN [BP-98008814-172.31.14.131-1676372558235 heartbeating to localhost/127.0.0.1:41671] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-14 11:02:45,339 WARN [BP-98008814-172.31.14.131-1676372558235 heartbeating to localhost/127.0.0.1:41671] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-98008814-172.31.14.131-1676372558235 (Datanode Uuid d3a8ba9d-7ed6-4414-9602-97f91f2371bd) service to localhost/127.0.0.1:41671 2023-02-14 11:02:45,340 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/cluster_a2d6ce3e-9d73-edfb-92fb-e637f68f7292/dfs/data/data1/current/BP-98008814-172.31.14.131-1676372558235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:45,340 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/82816d52-08fc-68eb-15f7-2b8b08590d92/cluster_a2d6ce3e-9d73-edfb-92fb-e637f68f7292/dfs/data/data2/current/BP-98008814-172.31.14.131-1676372558235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-14 11:02:45,353 INFO [Listener at localhost/43505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-14 11:02:45,467 INFO [Listener at localhost/43505] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-14 11:02:45,503 INFO [Listener at localhost/43505] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-14 11:02:45,523 INFO [Listener at localhost/43505] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=294 (was 275) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:41671 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43505 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:41671 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:41671 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:41671 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41671 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:41671 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1345003454) connection to localhost/127.0.0.1:41671 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40235,1676372558813)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=590 (was 565) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=263 (was 256) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=4814 (was 5561)